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FOREWORD 


The  Army  Is  committed  to  the  use  of  flight  simulators  to  augment  the 
training  that  Army  helicopter  pilots  receive  in  the  helicopter  itself.  The 
most  Important  reasons  for  this  commitment  are  discussed  In  the  main  body  of 
the  report.  For  now,  It  is  sufficient  to  say  that  the  use  of  flight  simulators 
to  augment  aircraft  training  Is  the  only  means,  during  peacetime,  of  achieving 
the  level  of  operational  readiness  that  Is  desired  at  an  acceptable  cost.  Until 
now,  nearly  all  the  resources  expended  by  the  Army  on  its  Synthetic  Flight 
Training  System  (SFTS)  program  have  been  aimed  at  hardware  development  and 
acquisition.  The  resources  devoted  to  research  on  how  best  to  us i  flight  simu¬ 
lators  Is  miniscule  by  comparison.  Hence,  It  is  not  surprising  that  there  are 
a  large  number  of  uncertainties  about  the  specific  role  of  flight  simulators 
In  the  Army's  aviator  training  program.  It  is  worth  noting  that  these  uncer¬ 
tainties  are  not  unique  to  the  Army;  both  the  Air  Force  and  Navy  are  faced 
with  much  the  same  problem. 

In  preparing  this  document,  the  authors  and  contributors  attempted  to  be 
thorough  in  identifying  critical  research  Issues.  Also,  to  the  extent  possible 
with  the  time  and  resources  available,  an  attempt  was  made  to  develop  research 
plana  that  address  the  Issues  In  a  meaningful  and  practical  way.  We  feel  con¬ 
fident  that  the  research  Issues  Identified  are  important  and  relevant.  However, 
we  do  not  consider  the  research  plans  presented  in  this  document  to  be  the 
only  way  or  necessarily  the  beat  way  to  deal  with  the  issues  identified.  When 
developing  long-term  research  on  a  topic  about  which  ao  little  is  known.  It 
must  be  expected  that  the  results  of  earlier  research  may  drastically  change 
one's  early  views  about  the  best  way  to  proceed.  In  short,  the  plans  for  later 
stages  of  the  research  must  be  considered  tentative  and  subject  to  change, 
based  upon  the  findings  of  earlier  research. 

It  can  be  argued  that  plans  for  research  on  such  a  difficult  topic  should 
proceed  in  a  step-by-step  fashion.  Indeed,  this  approach  Is  much  less  threaten¬ 
ing  to  the  research  planner  who  must  formulate  projects  based  on  premises 
several  levels  removed  from  any  empirical  data.  Also,  this  approach  Is  less 
likely  to  portray  to  decision  makers  a  research  requirement  that  initially 
appears  overwhelmingly  complicated  and  costly.  The  disadvantages  of  the  step- 
by-step  approach,  which  we  feel  far  offset  the  advantages,  are  twofold.  First, 
a  great  deal  of  time  and  research  continuity  would  be  lost  If  efforts  to  obtain 
funding  and  administrative  support  for  the  next  research  stage  were  not  com¬ 
menced  until  the  results  of  the  preceding  stage  have  been  fully  analyzed  and 
documented.  A  hiatus  between  each  stage  of  research  would  probably  serve  to 
make  a  difficult  job  impossible.  Second,  a  general  notion  of  the  scope  of  the 
research  is  needed  to  make  sensible  decisions  about  whether  or  not  to  embark 
on  the  research  and.  If  an  affirmative  decision  Is  made,  to  make  sensible 
decisions  about  how  best  to  marshal  the  resources  needed  to  continue  the  re¬ 
search  until  truly  useful  results  are  In  hand.  For  these  reasons,  we  have 
decided  that  relatively  detailed  long-term  plans — even  imperfect  ones — serve 
an  important  purpose. 

The  Intent  is  that  this  document  serve  as  a  beginning  of  dialogue  among 
the  agencies  and  personnel  who  share  responsibility  for  optimizing  the  benefits 


v 


of  the  Army's  SFTS  program.  It  la  hoped  that  this  dialogue,  In  turn,  will  lead 
to  the  refinement  of  Ideas,  to  the  establishment  of  research  priorities,  and  to 
joint  planning  by  all  involved  agencies.  It  is  important  that  the  reader  keep 
in  mind  that  this  is  not  a  document  being  submitted  for  approval  or  disapproval, 
in  total  or  in  part.  For  this  reason,  feedback  from  readers  about  ilS'/s  'n  the 
premises  and/or  reasoning  are  welcomed.  Comments  should  be  sent  uo  Charles 
A.  Gainer  at  the  following  address: 

Chief 

ARI  Field  Unit 

Attn:  PERI-IR  (Mr.  Charles  A.  Gainer) 

Fort  Rucker,  AL  36362-535A 


EDGAR  M.  JOHNSON 
Technical  Director 
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AN  ENUMERATION  OF  RESEARCH  TO  DETERMINE  THE  OPTIMAL  DESIGN  AND  USE  OF  ARMY 
FLIGHT  TRAINING  SIMULATORS 


EXECUTIVE  SUMMARY 


The  purpose  of  this  document  is  to  identify  the  types  of  research  needed 
to  determine  the  optimal  design  and  use  of  Army  flight  simulators.  Two  comple¬ 
mentary  lines  of  research  are  described  and  discussed.  One  line  of  research — 
referred  to  as  the  "Long-Term  Path" — focuses  primarily  on  simulator  design 
issues.  The  primary  focus  of  the  second  line  of  research — the  "Short-Term 
Path"— is  the  determination  of  the  best  way  to  use  the  flight  simulators  that 
have  been  or  are  soon  to  be  acquired  by  the  Army. 


LONG-TERM  PATH 

The  general  objectives  of  the  Long-Term  Path”-formulated  by  the  Assistant 
Secretary  of  the  Army  for  Research,  Development,  and  Acquisition — are  as  listed 
below! 

0  design  research  that  will  yield  the  data  needed  to  quantify  the  rela¬ 
tionship  between  fidelity  (in  selected  flight  simulator  design  param¬ 
eters)  and  training  transfer  (for  selected  flying  tasks), 

0  design  research  that  will  yield  the  data  needed  to  define  the  rela¬ 
tionship  between  flight  simulator  production  costs  and  required 
fidelity  in  the  selected  flight  simulator  design  parameters,  and 

o  design  research  to  define  the  type,  cost,  and  effectiveness  of  alter¬ 
nate  training  methods  and  media  that  could  be  used  in  lieu  of  flight 
simulators  to  train  one  or  more  of  the  selected  flying  tasks. 

In  response  to  the  general  research  objectives,  requirements  for  research 
were  defined  for  five  "primary"  research  areas  and  nine  "supportive"  research 
areas.  The  primary  research  areas  are  these: 

0  fidelity  requirements  for  visual  system, 

0  fidelity  requirements  for  motion  system, 

0  fidelity  requirements  for  simulator  handling  qualities, 
o  fidelity  requirements  for  cockpit  displays  and  controls,  and 
0  requirements  for  simulator  Instructional  Support  Features. 

The  supportive  research  areas  are  topical  areas  in  which  therp  are  prob¬ 
lems  or  uncertainties  that  must  be  resolved  in  order  to  conduct  effective  re¬ 
search  in  the  primary  research  areas.  Supportive  research  areas  identified 
and  discussed  include  the  following: 

o  flying  task  data  base, 
o  team/combined-arms  training  methods, 
o  performance  evaluation, 


o  alternative  training  media, 

0  subsystem  standardization/modularization, 
o  research  methodoiogy , 
o  skill  decay/maintenance , 

0  implementation/monitorlng  of  simulator  training,  and 
0  coat-effectiveness  analysis  models. 

The  discussion  of  each  of  the  above  research  areas  Includes  a  description 
of  the  research  issues  and  objectives,  comments  about  relevant  research  that 
has  been  reported  in  the  literature,  and  a  description  of  the  research  consid¬ 
ered  necessary  to  resolve  the  issues.  The  research  plans  vary  widely  in  detail 
and  complexity. 


SHORT-TERM  PATH 

The  Short-Term  Path  is  a  program  of  research  that  is  aimed  at  evaluating 
and  optimizing  the  use  of  the  family  of  flight  simulators  that  the  Army  already 
has  acquired  or  has  contracted  to  purchase.  Since  the  design  of  this  family  of 
simulators  is  more  or  less  fixed,  the  research  Is  focused  mainly  on  determining 
how  best  to  use  the  devices:  Who  should  be  trained?  What  tasks  should  be 
trained?  How  much  training  should  be  administered?  What  training  methods 
should  be  employed  for  each  training  application?  A  secondary  objective  of 
the  Short-Term  Path  is  to  Identify  design  modifications  (hardware  and/or  soft¬ 
ware)  that  will  improve  the  training  effectiveness  of  production  simulators 
without  incurring  excessive  product  improvement  costs. 

Three  major  research  efforts  are  described.  The  objective  of  the  first 
research  effort  is  to  determine  the  optimal  use  of  flight  simulators  in  a 
unit-training  context.  (Unit  training  refers  to  the  training  received  by  Army 
aviators  after  they  have  completed  Institutional  training  and  have  been  as¬ 
signed  to  an  operational  unit.)  The  research  is  designed  to  assess  the  simu¬ 
lator's  utility  for  five  different  training  applications:  refresher  training, 
skill  sustainment  training,  skill  enrichment  training,  accident  prevention 
training,  and  maintenance  test-pilot  training. 

The  objective  of  the  second  research  effort  is  to  evaluate  the  simula¬ 
tor's  utility  for  training  beginning  students  in  the  fundamentals  of  helicop¬ 
ter  operation.  A  three-phase  study  that  addresses  both  simulator  design  issues 
and  training  methodology  issues  is  described.  If  the  early  work  supports  the 
feasibility  of  the  concept,  transfer-of-trainlng  studies  will  be  conducted  to 
determine  the  optimal  mix  of  simulator  training  and  aircraft  training. 

The  objective  of  the  third  research  effort  is  to  determine  the  extent  to 
which  Night  Vision  Goggle  training  can  be  accomplished  in  a  flight  simulator 
equipped  with  a  visual  system. 
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AN  ENUMERATION  OF  RESEARCH  TO  DETERMINE  THE  OPTIMAL  DESIGN 
AND  USE  OF  ARMY  FLIGHT  TRAINING  SIMULATORS 


SECTION  I 
INTRODUCTION 

BACKGROUND  AND  OVERVIEW 

In  June  1982,  the  Assistant  Secretary  of  the  Army  for  Research, 
Development,  and  Acquisition  requested  that  Commander,  DARCOM,  form  a 
Flight  Simulator  Steering  Group  that  v>as  to  map  out  the  paths  future 
Army  flight  simulator  research  and  development  should  take.  Gravely 
concerned  about  the  escalating  complexity  and  cost  of  simulators,  the 
Assistant  Secretary  established  as  the  paths'  objectives  the  develop- 
raent/acquisitlon  of  only  such  simulator  training  capabilities  as  are 
absolutely  essential  and  the  consequent  maximization  of  simulator 
training  utility. 

The  initial  guidance  to  the  Group  was  that  it  provide  an  appraisal 
of  requirements  for  determining  three  issues: 

•  How  much  is  needed  in  simulation  for  effective  training 
transfer? 

•  What  path  should  development  follow  to  optimize  future  flight 
simulator  development? 

•  What  Army  policies  are  needed  to  manage  more  effectively  the 
simulator  program? 

The  Group's  membership  was  drawn  from  DARCOM,  TRADOC,  and  the  Army 
Research  Institute  (ARI)  and  has  represented  in  it,  from  both  the 
training  and  materiel  communities,  researchers,  developers,  and 
managers.  This  research  plan  outlines  the  researchers'  and  developers' 
responses  to  the  first  two  of  the  Assistant  Secretary's  Issues.  Manage¬ 
ment  policies  are  not  directly  addressed,  but  the  basic  input  for  policy 
formulation  is  provided. 

The  research  plan  has  three  complementary  sections:  this  intro¬ 
duction  (Section  I)  and  two  proposed  Integrated  research  plans  (Section 
II  and  Section  III). 

Following  this  overview,  the  Introduction  operationally  defines 
key  terms  as  they  are  used  in  the  research  plan  and  then  details  basic 
assumptions  and  concepts  that  have  had  a  major  Impact  on  the  formulation 
of  the  research  plan.  Current  constraints  on  flight  simulator  research 
and  de'-elopment  are  then  Identified  and  discussed.  The  Introduction  is 
concluded  with  a  statement  of  the  rationale  for  the  two  paths  of 
research  proposed  in  Sections  II  and  III. 


The  next  two  sections  map  out  two  paths  of  tesearch:  a  Long-Term 
Path  (Section  II)  and  a  Short-Term  Path  (Section  III),  The  Long-Term 
Path  Is  aimed  at  providing  comprehensive  data  for  future  requirements 
and  at  utilizing  future  technology.  Five  research  areas  are  identified 
as  the  primary  domain  of  the  Long-Term  Path;  fidelity  requirements  for 
visual  systemst  fidelity  requirements  for  motion  systems,  fidelity 
requirements  for  simulator  displays  and  controls,  fidelity  requirements 
for  simulator  handling  qualities,  and  requirements  for  Instructional 
Support  Features.  Secondary  areas  of  required  long-term  supporting 
research  are  also  identified.  The  Short-Term  Path  is  aimed  at  answering 
questions  about  the  optimal  use  of  flight  simulators  that  will  have  been 
acquired  by  the  Army  before  the  long-term  research  on  simulator  fidelity 
requirements  has  been  completed. 


DEFINITIONS 

In  preparing  this  research  plan,  It  became  readily  evident  that, 
across  and  within  different  disciplines,  a  technical  term  may  have 
slightly  or  even  greatly  varying  connotations  or  meanings.  Thus,  since 
the  research  plan  Is  intended  for  a  multidisciplinary  audience,  it  was 
deemed  necessary  to  posit  definitions  of  certain  key  terms  that  are  used 
throughout  the  research  plan. 


FIDELITY 

"Fidelity"  is  both  the  most  critical  single  term  in  this  research 
plan  and  the  most  111-deflned  in  the  area  of  simulation.  It  Is  gener¬ 
ally  understood  and  accepted  that  the  term  refers  to  Che  degree  of 
correspondence  between  some  aspect  of  the  simulator  and  some  aspect  of 
the  aircraft  or  environment,  but  the  nature  of  the  correspondence  is  at 
best  unclear. 

Implicit  in  the  term  is  the  concept  that  to  have  full  fidelity  a 
simulator  must  accurately  reproduce  its  real-world  counterpart  both  in 
form  and  in  function.  This  view  of  fidelity,  which  has  been  designated 
"objective  fidelity"  (AGARD,  1980),  arises  from  the  supposition  that  the 
most  effective  training  device  Is  the  aircraft  itself  and,  thus,  the 
effectiveness  of  a  simulator  is  a  direct  function  of  how  well  It  dupli¬ 
cates  the  aircraft.  This  approach,  which  tacitly  considers  the  simu¬ 
lator  a  "tethered  aircraft,"  very  quickly  leads  to  exorbitant  simulator 
design  requirements:  as  simulator  visual  uystems,  motion  systems,  etc., 
approach  an  accurate  replication  of  the  real  world,  cost  very  rapidly 
becomes  prohibitive. 

An  alternate,  and  potentially  more  economical,  view  is  that 
fidelity  be  defined  as  the  degree  to  which  the  student  perceives  the 
simulator  to  replicate  the  aircraft.  Termed  "perceptual  fidelity" 
(AGARD,  1980),  this  view  arises  from  the  supposition  that  only  those 
elements  of  the  training  environment  that  can  be  perceived  by  the 


student  need  be  simulated  and  that  the  imperceptible  elements  may  be 
Ignored. 

But  defining  fidelity  (and  simulator  design  requirements)  solely 
in  terms  of  elements  critical  to  perception  of  the  simulator  as  a 
replication  of  the  aircraft  Ignores  another  very  Important  aspect  of 
flight  training.  A  great  deal  of  very  effective  initial  training  Is 
conducted  in  a  training  environment  much  different  from  the  operational 
aircraft,  For  example,  In  training  helicopter  hovering  operations,  the 
Instructor  nay  retain  directional  (pedal)  control  while  allowing  the 
trainee  altitude  and  attitude  (collective  and  cyclic)  control.  Or,  the 
trainee  nay  be  instructed,  by  way  of  an  analogy,  to  fly  a  maneuver  from 
one  point  to  another  by  following  an  imaginary  aerial  pathway  connecting 
the  two  points.  Neither  of  these  two  examples  is  "faithful"  to  the 
real-world  operational  environment,  yet  both  are  highly  effective 
techniques  for  training.  And  both.  In  a  sense,  have  high  fidelity  with 
respect  to  the  trainee's  internalized  schema  or  model  of  flying;  that 
is,  they  have  what  might  be  termed  "training  fidelity"  since  they  are 
applicable  to  the  development  or  to  the  sustainment  of  aviators'  inter¬ 
nalized  programs  of  flying. 

So,  for  purposes  of  this  research  plan,  any  simulator  property 
that  is  shown  to  be  effective  (as  defined  below)  In  developing  or 
maintaining  flight  skills  will  be  operationally  defined  as  having 
fidelity,  The  primary  research  areas  in  the  Long-Term  Path  of  Section 
II,  address  both  "perceptual  fidelity"  and  "training  fidelity." 


TRAINING  EFFECTIVENESS 

A  simulator  Is  characterized  as  being  effective  in  the  training  of 
some  task  or  maneuver  to  the  extent  that  training  using  the  simulator 
results  In  less  training  being  required  In  the  aircraft  to  attain  or 
maintain  performance  criteria.  Obviously,  a  simulator  Is  then  ineffec¬ 
tive  If  training  In  It  results  in  no  change  in  or  an  increase  in  the 
amount  of  subsequently  required  aircraft  training.  Notice  that  this 
definition  Is  silent  concerning  the  amount  of  simulator  training 
required  to  reallf.e  the  training  effectiveness;  that  is,  it  does  not 
address  the  "training  efficiency"  of  the  simulator. 


COST  EFFECTIVENESS 

Closely  associated  with  training  effectiveness  is  the  concept  of 
cost  effectiveness,  or  the  cost  associated  with  attaining  training 
effectiveness.  Relative  to  some  training  alternative  (usually  the 
aircraft  alone),  a  simulator  Is  considered  more  cost  effective  if  It 
allows  achievement  of  the  same  training  objective  at  a  lower  total  cost. 

In  considering  training-effectiveness  and  cost-effectiveness 
interrelationships,  one  slioiild  boar  in  mind  that  it  is  entirely  conceiv¬ 
able  that  a  simulator  may  exhibit  training  effectiveness  but  still  be 
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cose  Ineffective  compared  to  training  using  the  aircraft  alone.  Simu¬ 
lator  acquisition  and/or  operation  cost  may  be  so  great  as  to  offset  the 
benefits  realized  from  simulator  training.  On  the  other  hand,  a  simu¬ 
lator  with  low  acquialtlon/operatlon  cost  may  be  so  lacking  in  training 
effectiveness  that  it  also  Is  not  cost  effective  compared  to  other 
alternatives.  This  research  plan  Is  especially  concerned  with  the 
relative  cost  effectiveness  of  various  simulator  design  options  and,  In 
particular,  with  determination  of  the  point  or  points  at  which  the 
payback  in  training  effectiveness  falls  to  keep  pace  with  the  cost  of 
Increased  fidelity. 


BASIC  ASSUMPTIONS  AND  CONCEPTS 

All  coherent  programs  of  research,  present  effort  Included,  must 
be  guided  by  an  explicit  consensual  set  of  assumptions  and  concepts. 
Those  assumptions  and  concepts  that  apply  to  this  program  are  discussed 
below.  These  have  been  derived  from  the  literature  review  and  form  the 
basis  for  the  Section  II  and  the  Section  III  research  plans. 


TRAINING  RESOURCES  AND  REQUIREMENTS 

A  fundamental  premise  underlying  this  effort  Is  that  simulation 
will  become  an  increasingly  important  tool  in  the  Army  aviation  inven¬ 
tory.  The  growing  constraints  on  in-flight  training  are  seen  as  the 
primary  driver  for  the  increase.  The  litany  of  constraints  includes 
increasing  cost  of  aircraft  operation,  Increasing  cost  of  training 
ordnance,  local  limitations/prohibitions  against  terrain  and  night 
flight,  and  lack  of  adequate  gunnery  ranges.  It  Is  assumed  that,  in 
general,  these  constraints  on  training  resources  will  grow  more  strin¬ 
gent  over  time. 

At  the  same  time,  it  is  clear  that  training  requirements  are 
increasing,  Aviation  training  must  change  its  overall  emphasis  from 
individual  aircrew  training  to  combined  arms  training.  New  systems, 
such  ns  the  AfdP  and  AH-64,  are  being  fielded  with  more  and  more  complex 
subsystems  which  require  more  and  more  training.  It  must  be  assumed 
that,  in  general,  the  training  requirements  will  continue  to  increase 
over  time.  Simulation  Is  seen  as  the  primary  tool  available  to  recon¬ 
cile  shrinking  training  resources  with  expanding  training  requirements. 


ROLE  OF  FLIGHT  SIMULATION 

As  was  implied  above,  flight  simulation,  in  concept,  is  to  be 
considered  roorely  as  one  of  several  alternative  training  media  and  not 
as  an  end  unto  itself.  Flight  simulation  is  only  one  of  several  methods 
at  the  disposal  of  the  training  developer  for  meeting  the  requirements 
of  an  Integrated  training  system.  However,  in  practice,  the  Army  has  in 
its  most  recent  flight  simulator  acquisitions  pursued  a  goal  of 


developing  devices  capable  of  training  equally  well  the  entire  gamut  of 
flight  tasks#  The  Immediate  result  of  this  course  of  action  has  been  a 
low-density  fielding  of  high-cost  devices  among  a  high-density  trainee 
population.  The  cost  of  the  devices  limits  their  proliferation,  and  the 
size  of  the  trainee  population  these  few  devices  must  service  severely 
restricts  the  amount  of  simulator  training  time  available  to  each 
trainee.  There  are  reasons  to  suspect  that  the  methods  presently  used 
to  define,  training  requirements  (and  consequently  training  systems) 
either  are  Inadequate  or  are  not  applied  with  sufficient  discipline,  or 
both.  The  role  of  flight  simulation  Is  to  fulfill  specific  training 
needs  that  are  systematically  determined  as  part  of  development  of  an 
Integrated  training  system,  but  there  Is  some  question  as  to  the 
validity  of  the  present  processes  of  identifying  and  filling  training 
needs . 


PURPOSES  OF  FLIGHT  SIMULATION 

In  the  broadest  sense,  flight  simulation  is  an  economy  measure  in 
flight  training.  The  supposition  has  always  been  that  relatively 
Inexpensive  simulator  training  can  be  used  to  replace  some  (preferably 
large)  fraction  of  relatively  expensive  aircraft  training  in  the  attain¬ 
ment  of  some  set  level  of  flight  proficiency.  To  date,  the  Army  has 
used  the  principle  of  economy  through  simulator-for-alrcraf t  substitu¬ 
tion  in  current  flight  training  operations  as  the  primary  purpose  and 
justification  for  its  flight  simulation  program. 

In  addition  to  flight-hour  substitution,  there  are  at  least  two 
other  broad  purposes  for  simulation.  One  Is  Increased  safety,  not  only 
during  training, but  also  during  operational  flight  subsequent  to  simu¬ 
lator  training  on  Inherently  dangerous  tasks  or  maneuvers.  The  other 
purpose  Is  Increased  operational  readiness  resulting  from  training 
conducted  in  the  simulator  that  cannot  be  conducted  effectively  in  the 
aircraft  during  peacetime.  These  two  purposes  are  often  ignored  because 
their  cost  effectiveness  are  difficult  to  quantify.  But  the  fact 
remains  that  increased  safety  and  operational  readiness  are  potentially 
significant  benefits  of  current  and  future  simulators,  and  the  need 
remains  to  develop  methods  for  quantifying  the  benefit  derived  from 
simulators  so  designed. 


AREAS  OF  APPLICATIO’,: 

In  general,  all  Army  aviation  training  requirements  can  be  classi¬ 
fied  using  two  dichotomous  dimensions:  stage  of  training  and  level  of 
training  participation.  Stage  of  training  can  be  categorized  into  skill 
acquisition  training  and  skill  rustalnment  training.  Level  of  training 
participation  can  be  categorized  Into  individual  training  and  collective 
training.  The  individual  versus  collective  training  distinction  is 
fairly  straightforward;  the  skill  acquisition  versus  skill  sustainment 
training  distinction  can  be  alternately  conceptualized  as  how-to-fly 
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versus  how-to-flght.  Skill  acquisition  training  refers  to  training  that 
is  primarily  institutional  and  concentrates  on  learning  to  operate  the 
aircraft  competently.  Skill  sustainment  training  refers  to  training 
that  is  accomplished  primarily  in  the  field  and  (although  it  does  not 
neglect  aircraft  operation)  concentrates  on  learning  to  employ  the 
aircraft  as  a  combat  system.  Although  there  is  in  practice  some  overlap 
of  training  among  the  cells .  this  2x2  categorization  is  useful  in 
examining  the  status  of  present  flight  simulation  applications  and  the 
directions  future  applications  should  follow. 

Present  Amy  flight  simulators  have  all  been  designed  with  the 
primary  application  in  one  area:  initial  Individual  training.  Acquisi¬ 
tion  strategy  has  been  to  evaluate  prototype  simulators'  effectiveness 
for  initial  training  of  individual  aviators  in  the  institutional  setting 
and  then  to  procure  production  simulators,  still  built  to  answer  initial 
individual  training  requirements)  for  sustainment  of  individual  skills 
in  the  field.  Along  with  the  short  shrift,,  individual  skill  sustainment 
training  has  been  given  by  Amy  simulation)  an  even  greater  void  exists 
in  the  area  of  collective  sustainment  training.  Even  though  there  is  a 
consensus  that  collective  sustainment  training  requirements  are  going 
largely  unfilled)  the  Army  has  only  recently  begun  efforts  toward 
developing  simulators  for  collective  or  team  training. 


CONSTRAINTS  ON  SIMULATOR  RESEARCH 

To  develop  a  realistic  research  program  dealing  with  simulator 
design)  it  is  essential  to  consider  the  constraints  that  make  it 
difficult  to  design  and  conduct  such  research.  Although  a  number  of 
major  and  minor  constraints  exist  for  any  type  research)  there  are  four 
constraints  that  have  a  major  Impact  on  Che  design  and  conduct  of 
research  to  define  the  effect  of  simulator  design  on  training 
effectiveness , 


LACK  OF  RESEARCH  EQUIPMENT 

There  is  presently  a  lack  of  research  equipment  that  would  enable 
researchers  Co  measure  transfer-of-tralning  as  simulator  design  parame¬ 
ters  are  systematically  varied.  This  constraint  is  particularly  detri¬ 
mental  for  research  aimed  at  quantifying  the  training  benefits  realized 
from  different  levels  of  fidelity.  This  constraint  can  be  removed  by 
conducting  some  of  the  essential  research  using  present  simulators  with 
temporary  modifications  (via  the  Short-Term  Path)  and  by  developing  a 
research  capability  speciflca.lly  for  this  application  (via  the  Long-Term 
Path).  The  issue  of  research-equipment  requlrnments  must  be  resolved 
prior  to  undertaking  any  comprehensive  program  of  research. 


LIMITED  ACCESS  TO  TEST  POPULATION 


Research  on  the  use  of  flight  simulators  for  Institutional 
training  disrupts  the  training  process  and  may  adversely  affect  Che 
students'  chances  of  successfully  completing  Che  institutional  program. 
Similarly,  research  on  the  use  of  flight  simulators  for  continuation 
training  in  the  field  is  certain  to  disrupt  unit  training  activities 
and,  consequently  I  unit  operational  readiness.  It  is  not  surprising 
that  both  Institutional  training  managers  and  unit  commanders  are 
reluctant  to  support  such  research.  Unfortunately,  an  acceptable 
alternative  to  using  aviators  as  subjects  has  not  been  found. 


PERFORMANCE  MEASUREMENT 

In  principle,  an  output  on  nearly  any  control  action  and  nearly 
any  flight  parameter  of  interest  can  be  obtained  from  current  flight 
simulators.  Yet,  a  great  deal  remains  to  be  learned  about  the  set  of 
parameters  that  constitute  the  most  valid  and  reliable  index  of  profi¬ 
ciency  on  a  given  flight  task  or  maneuver.  Obtaining  objective  measures 
of  flight  proficiency  is  an  even  greater  problem  In  the  alrerafc  because 
both  an  instrumented  aircraft  and  an  Instrumented  range  are  required  to 
obtain  accurate  measures  of  aircraft  attitude  and  position.  Again, 
relatively  little  is  known  about  the  set  of  measures  that  constitute  the 
moat  valid  and  reliable  index  of  flight  proficiency  in  the  aircraft. 
Although  valid  research  is  possible  using  Instructor  pilots'  Judgments 
of  proficiency,  more  efficient  research  would  be  possible  with  an 
automated  performance  measurement  capability  in  both  the  simulator  and 
the  aircraft. 


EFFECTIVENESS  ASSESSMENT  METHODOLOGIES 

The  literature  contains  well-defined  methods  and  Indices  for 
measuring  the  extent  to  which  training  in  a  training  device  transfers  to 
performance  in  the  aircraft.  However,  these  methods  and  indices  apply 
nnly  to  the  initial  acqui.sltion  of  flying  skills.  Far  loss  has  been 
accomplished  in  developing  msthodalogies  appropriate  for  assessing  the 
utility  of  a  training  device  for  preventing  the  loss  of  flying  skills 
already  acquired  or  for  reacquiring  skills  Chat  have  degraded  as  a 
result  of  lack  of  practice.  Such  methodologies  are  essential  for 
assessing  the  utility  of  flight  simulators  for  sustainment  training  and 
refrc.sher  training. 


PROPOSED  PROGRAM  OF  RESEARCH;  AN  OVERVIEW 

The  bro.ad  objective  of  the  program  of  research  is  to  compile  d.ata 
needed  to  specify,  for  individual  flight  tTsks,  the  fidelity  of  e.ach 
simulator  design  parameter  and  training  feature  that  will,  yield  the  most 
cost-effective  training.  To  accomplish  this  objective,  research  must  be 
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conducted  to  quantify  the  relationship  between  fidelity  and  training 
effectiveness;  and  training-cost  data  must  be  collected  or  extrapolated 
to  determine  relative  cost  effectiveness  of  training  alternatives. 
Specific  research  objectives  Chat  must  be  met  by  this  program  are  as 
follows: 

•  Design  and  conduct  research  to  obtain  the  data  needed  to 
quantify  the  relationship  between  training  fidelity  and  training 
effectiveness. 

•  Design  and  conduct  research  to  obtain  the  data  needed  Co  define 
the  relationship  between  flight  simulator  life-cycle  cost  and 
training  fidelity. 

•  Design  and  conduct  research  to  define  the  type,  cost,  and 
training  effectiveness  of  training  methods  and  media  that 
represent  alternatives  to  simulator  training. 

A  substantial  amount  of  time  and  effort  will  be  required  to  (a) 
complete  the  research  needed  to  fully  quantify  the  relationship  between 
training  fidelity  and  training  effectiveness,  and  (b)  apply  the  research 
findings  in  developing  new  flight  simulators  and  other  training  devices. 
It  is  esaentlal  Co  recognize,  however,  that  the  aviator  training 
problems  Chat  exist  today  cannot  simply  be  ignored  until  this  research 
has  been  completed  and  Che  results  applied.  One  solution  to  this 
dilemma  is  to  promulgate  two  complementary  paths  of  research,  as  illus¬ 
trated  in  Figure  1. 

The  Long-Term  Path,  which  is  to  commence  simultaneously  with  the 
Short-Term  Path,  is  a  program  of  primarily  basic  and  exploratory 
research  concentrating  on  training  fidelity  requirements  and  on  training 
technique  development.  In  this  program,  training  and  cost  effectiveness 
of  various  training  fidelity  profiles  will  be  evaluated,  and  emerging/ 
future  training  hardware  capabilities  will  be  exploited.  Thus,  Che 
program  must  remain  flexible  in  order  to  remain  responsive  to  advances 
in  technology  and  also  to  changes  in  operational  requirements. 

The  Short-Term  Path  is  a  program  of  research  that  Is  aimed  at 
evaluating  and  optimizing  the  use  of  tl>e  family  of  flight  simulators 
that  the  Army  already  has  acquired  or  has  contracted  to  purchase.  For 
the  most  part,  the  design  of  this  family  of  flight  simulators  is  fixed 
or  will  have  been  flxed_  long  before  the  research  envisioned  for  the 
Long-Term  Path  can  be  completed,  (Flight  simulators  in  this  family 
Include:  the  UHlFS,  the  AHlFS,  the  CH47FS,  the  Uh60FS,  and  the  AH64FS.) 
Thus,  the  fundamental  objectives  of  the  Short-Term  Path  research  are  (a) 
to  determine  the  best  way  to  employ  the  family  of  flight  simulators  that 
have  been  or  are  soon  to  be  fielded,  and  (b)  to  identify  design  modifi¬ 
cations  (hardware  and/or  software)  that  will  improve  the  training 
effectiveness  of  fielded  simulators  without  incurring  considerable 
product  improvement  costs. 


LONG-TERM  RESEARCH  PATH 


Figure  1.  Long-Term  and  Short-Term  Paths  for  Army  flight  simulator 
research. 


The  Short-Term  Path  research  plan  described  in  Section  III  focuses 
primarily  on  the  use  of  flight  simulators  for  unit  training — that  is, 
the  training  of  aviators  who  have  completed  institutional  training  and 
have  been  asslRned  to  an  operational  unit.  The  use  of  simulators  in  a 
unit-training  context  includes  but  is  by  no  means  limited  to,  skill 
sustainment  training.  As  is  discussed  in  Section  III,  it  seems  highly 
probable  that  flight  simulators  also  will  enable  aviators  to  reacquire 
skills  more  efficiently  (refresher  training)  and  to  acquire  a  higher 
level  of  skill  (enrichment  training)  on  some  tasks  than  is  possible 
through  aircraft  training  alone. 

Although  the  Short-Term  Path  research  plan  focuses  primarily  on 
the  use  of  simulators  for  unit  training,  two  other  research  projects  are 
Included  that  deal  with  the  use  of  flight  simulators  for  institutional 
training.  The  purpose  of  one  project  is  to  assess  the  extent  to  which 
contact  flight  training  in  a  simulator  equipped  with  an  external  visual 
system  transfers  to  a  UH-IH  aircraft  for  initial  entry  flight  students. 
This  line  of  research  has  been  given  the  acronym  THIESIS  (Training 
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Helicopter  Initial  Entry  Students  in  Simulators).  The  fundamental 
question  is  whether  a  flight  simulator  can  be  used  in  lieu  of  the  TH-S5 
aircraft  to  teach  beginning  flight  students  rudimentary  flying  skills. 
The  purpose  of  the  second  project  is  to  determine  the  extent  to  which 
Night  Vision  Goggle  training  can  be  accomplished  in  a  flight  simulator 
equipped  with  a  Visual  system. 

It  is  Important  that  the  limited  focus  on  institutional  training 
not  be  Interpreted  as  an  indication  that  there  are  no  significant 
requirements  for  research  to  evaluate  and  optimize  the  use  of  flight 
simulators  for  Institutional  training.  This  is  clearly  not  Che  case. 
The  heavy  emphasis  on  unit  training  applications  of  flight  simulators  is 
merely  a  matter  of  priorities.  Many  more  simulators  and  many  more 
aviators  are  Involved  in  unit  training  than  Institutional  training  at  a 
given  point  in  time.  Moreover,  far  less  empirical  data  are  available  on 
the  use  of  flight  simulators  for  unit  training  than  for  Institutional 
training.  Considerable  thought  was  given  to  proposing  that  a  major 
research  effort  on  institutional-training  applications  of  flight  simu¬ 
lators  be  conducted  concurrently  with  the  research  on  unit-training 
applications.  This  approach  was  rejected  because  of  limited  research 
resources  and  because  of  the  high  likelihood  that  the  results  of 
research  conducted  in  the  field-unit  context  will  generalize  to  the 
institutional-training  context. 

Although  not  discussed  as  a  part  of  this  research  plan,  it  Is 
essential  Chat  a  mechanism  be  established  to  ensure  two-way  communica¬ 
tion  between  operational  personnel  and  the  personnel  who  are  responsible 
for  managing  the  Long-Term  Path  and  the  Short-Term  Path  reseijcch,  The 
block  in  Figure  1,  entitled  "Technology  Transfer  and  User  Support," 
emphasizes  this  requirement.  On  Che  one  hand,  the  research  from  both 
paths  should,  yield  findings  that  can  immediately  be  applied  to 
increasing  the  effectiveness  of  the  Array's  aviator  training  sj'stcra.  On 
the  ocher  hand,  the  research  programs  must  remain  responsir'e  to  the 
changes  that  affect  training — system  requirements  and  constraints  such 
as:  changes  in  the  threat,  changes  in  the  Army's  tactics  and  doctrine, 

changes  in  the  training  population,  changes  in  resource  limitations,  the 
introduction  of  aircraft  modif icatious,  and  the  acquisition  of  new 
aircrafe  and  weapon  systems. 

The  next  two  sections  of  this  report  discuss  the  Long-Term  Path 
and  the  Short-Term  Path  research  in  detail. 


SECTION  II 

BASIC  .CONCEPT/REQUIREMENT 
RESEARCH  (LONG-TER^I  PATH) 

This  section  describes  Che  basic  concept/raqulremenCs  research 
proposed  for  the  Long-Term  Path.  Although  every  research  topic 
discussed  In  this  section  addresses  recognized  problems  associated  with 
training  Army  helicopter  avlatots,  many  of  the  research  topics  are  not 
unique  to  Army  aviator  training.  A  substantial  proportion  of  the  topics 
are  presently  under  investigation  by  one  or  more  branches  of  Che  U.S. 
military  or  by  private  industry.  Furthermore,  plans  to  initiate 
research  on  other  germane  topics  have  already  been  made  by  Che  U.S.  Army 
(PM  TRADE,  1982),  by  other  branches  of  the  U.S.  military  (AFHRL,  1983), 
and  by  Industrial  organizations. 

So,  the  implementation  of  the  proposed  program  will  not  neces¬ 
sarily  require  the  establishment  of  new  research  agencies  or  the 
establishment  of  new  work  areas  within  existing  research  agencies.  For 
Che  most  part,  the  activities  required  to  implement  the  proposed  program 
consist  of  (a)  redirection,  change  in  emphasis,  or  change  in  scope  of 
research  that  is  presently  underway  or  planned;  and  (b)  establishment  of 
a  mechanism  to  ensure  effective  interagency  coordination. 

Because  of  Che  availability  of  research  facilities  and  personnel, 
it  seems  certain  that  research  on  many  topics  of  Interest  can  be 
conducted  at  agencies  such  as  the  Ames  Research  Center,  the  ARI  Field 
Unit  at  Fort  Rucker,  ARI  Headquarters,  the  Army  Human  Engineering 
Laboratory,  the  Air  Force  Human  Resources  Laboratory  (AFHRL),  and  the 
Naval  Training  Equipment  Center  (NTEC) .  However,  when  research  is 
conducted  at  AFHRL  or  at  NTEC,  it  is  essential  that  Array  representatives 
be  involved  in  Che  research  design  to  ensure  that  the  results  can  be 
generalized  to  rotary-wing  aircraft  and  to  Army  missions. 


GENERAL  OBJECTIVES 

The  general  objectives  of  the  long-term  line  of  research  are  fully 
responsive  to  Secretary  Scully's  tasking  of  the  Simulator  Steering 
Group.  They  are  as  follows: 

•  to  design  and  conduct  research  that  will  yield  the  data  needed 
to  quantify  the  relationship  between  fidelity  (in  selected 
flight  simulator  design  par,ameters)  and  training  transfer  (for 
selected  flying  tasks) , 
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•  to  design  and  conduct  research  that  will  yield  the  data  needed 
to  define  the  relationship  between  flight  simulator  production 
costs  and  required  fidelity  in  the  selected  flight  simulator 
design  parameters,  and 

e  to  design  and  conduct  research  to  define  the  type,  cost,  and 
effectiveness  of  alternate  training  methods  and  media ^  that 
could  be  used  in  lieu  of  flight  simulators  to  train  one  or  more 
of  the  selected  flying  tasks. 


OVERVIEW 

Figure  2  illustrates  the  main  attributes  of  the  long-term  line  of 
research.  First,  the  figure  lists  the  areas  in  which  some  form  of 
research  must  be  conducted  in  order  to  accomplish  the  general  research 
objectives  presented  above.  The  primary  reseaich  areas  are  the  first 
ones  listed!  "Fidelity  Requirements"  and  "Instructional  Support 
Features."  The  remaining  research  areas  are  considered  supportive  in 
the  sense  that  problems  or  uncertainties  in  each  of  these  areas  must  be 
resolved  in  order  to  conduct  effective  research  in  the  primary  research 
areas.  In  this  sense,  the  supportive  research  areas  can  be  considered 
no  less  essential  to  the  success  of  the  long-term  research  program  Chen 
Che  primary  research  areas. 

Second,  Figure  2  emphasizes  that  the  long-term  line  of  research 
must  not  only  be  responsive  to  current  operational  requirements,  but 
must  also  be  designed  to  recognize  and  accommodate  (a)  changes  in 
operational  requirements  and  (b)  advances  in  training  end  training- 
device  technology.  It  is  essential  chat  every  attempt  be  made  to  design 
the  research  In  such  a  manner  that  the  findings  and  conclusions  are  not 
invalidated  by  changes  in  operational  requirements  or  by  technological 
innovations. 

Finally,  Figure  2  identifies  the  purposes  served  by  the  research 
findings.  As  was  Indicated  In  Figure  I,  the  results  of  the  long-term 
lino  of  research  will  have  a  direct  impact  on  the  other  elements  of  the 
proposed  Rf.D  program.  Rpeciflcal  ly ,  germane  research  findings  will  be 
employed  to  improve  the  design  .nnd  u.se  of  fielded  components*’  of  the 


*The  term  "training  media"  la  used  in  its  broadest  sense  throughout  this 
plan.  The  term  encompasses  self-study  books  and  manuals,  classroom 
teaching  aids  and  equipment,  and  equipment  generally  referred  to  as 
training  devices.  Where  more  specificity  is  required,  the  specific, 
media  will  be  named.  This  usage  corresponds  to  that  recommended  in 
MIL-T-29053AfTD)  (1979). 

^Thls  assumes  that  some  of  the  r  ’.uits  of  the  ..oug-torra  line  of  research 
will  be  av-allable  soon  enough  to  h.ave  an  Impact  on  the  short-term  line 
of  research. 
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flight-training  system  (Technology  Transfer  and  User  Support).  Addi¬ 
tionally  ,  the  long-term  line  of  research  should  serve  to  (a)  generate 
new  concepts  in  training  methods  and  training  media,  and  (b)  highlight 
areas  in  which  there  Is  an  urgent  need  for  Innovation  In  training 
methods  and  training  media  technology. 

Each  of  the  research  areas  Is  discussed  below.  The  primary 
research  areas— Fidelity  Requirements  and  Instructional  Support 
Features — are  discussed  in  considerably  more  detail  than  the  supportive 
research  areas  because,  for  the  most  part,  they  are  more  complex  and  of 
more  central  importance.  In  every  case,  however,  an  attempt  has  been 
made  to  explain  why  research  in  the  area  is  needed  and  to  describe,  at 
least  in  general  terms,  the  type  of  research  that  is  needed. 

The  main  focus  of  the  long-term  line  of  research  is  clearly 
"simulator  fidelity  requirements."  The  objectives  of  research  in  this 
area  are  precisely  the  same  as  those  stated  earlier.  In  order  to 
quantify  the  relationship  between  fidelity  and  training  effectiveness, 
the  effect  of  fidelity  on  training  must  be  Investigated  for  at  least 
four  components  of  a  flight  simulator:  the  visual  system,  the  motion 
system,  the  handling  qualities,  and  the  simulator  cockpit  displays  and 
controls.  A  discussion  of  the  research  requirements  for  each  of  these 
components  is  followed  by  a  discussion  of  the  research  required  in  the 
area  of  training  techniques. 

The  term  "Instructional  Support  Features"  (ISF)  is  used  in  Figure 
2;  throughout  this  report,  ISF  refers  to  simulator  hardware  and  software 
capabilities  that  allow  the  instructor/operator  to  manipulate,  supple¬ 
ment,  and  otherwise  control  the  learning  experiences  of  the  student  to 
maximize  the  rate  and  level  of  skill  acquisition  (Hughes,  1979). 
Research  on  ISFs  has  been  selected  as  a  primary  research  area  because 
ISFs  have  the  potential  for  having  a  major  impact  on  both  simulator  cost 
and  training  effectiveness.  Caro  (1977b)  has  argued  convincingly  that 
instructional  methods  used  in  flight  simulator  training  may  have  as  much 
or  more  Impact  on  training  effectiveness  as  the  training-equipment 
design.  Empirical  support  for  Caro's  argument  is  found  in  a  study  of 
different  levels  of  visual  scene  fidelity  for  a  shiphandllng/shipbridge 
simulator  (Hammell,  Gynther,  Grasso,  4  Gaffney,  1981).  In  that  study, 
instructional  method  differences  were  found  to  have  several  tiroes  as 
much  Impact  on  training  of feccivenesv.  as  any  of  the  fidelity  of  simula¬ 
tion  varl'hblos  that  were  studied.  Furthermore,  there  is  considerable 
anecdotal  evidence  and  some  empirical  evidence  that  many  of  the  capa¬ 
bilities  of  contemporary  Army  flight  simulators  go  unused  because 
effective  training  techniques  have  not  yet  been  developed  (Charles, 
Willard,  &  Healey,  1976;  Gray,  Chun,  Warner,  4  Eubanks,  1981). 

The  proposed  long-term  line  of  research  is  described  under  the  six 
major  subsection  titles  listed  below: 

•  Fidelity  Requirements  for  Visual  System, 

•  Fidelity  Requirements  for  Motion  System, 

•  Fidelity  Requirements  for  Simulator  Displays  and  Controls, 
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•  Fidelity  Requirements  for  Simulator  Handling  Qualities, 

•  Requirements  for  Instructional  Support  Features,  and 

•  Supportive  Research  areas. 

If  this  program  is  approved  in  principle,  it  will  be  necessary  for 
members  of  the  Army  Flight  Simulator  Steering  Group  to  meet  with 
representatives  of  selected  Army  agencies  and  with  representatives  of 
other  branches  of  the  service  to  establish  priorities  for  the  research, 
to  decide  which  service/agency  should  assume  primary  responsibility  for 
each  research  area,  to  estimate  the  resources  (personnel,  equipment,  and 
funds)  required,  and  to  establish  specific  milestones. 


FIDELITY  REQUIREMENTS  FOR  VISUAL  SYSTEM 

The  characteristics  of  a  flight  simulator's  visual  system  have  an 
enormous  Impact  on  the  range  of  flying  tasks  that  can  be  taught  in  the 
simulator  and  on  the  effectiveness  with  which  they  can  be  taught.  The 
characteristics  of  a  simulator's  visual  system  also  have  an  enormous 
Impact  on  the  simulator's  procurement  cost,  operation  costs,  and  mainte¬ 
nance  costs.  For  more  than  two  decades,  there  has  been  a  continuing 
effort  to  produce  visual  systems  with  ever-increasing  fidelity.  Simu¬ 
lator  designers  and  users  alike  have  assumed  that  higher  fidelity  visual 
systems  will  result  in  more  effective  training.  This  assumption  nay 
have  been  more  or  less  valid  until  recently,  Currently,  however, 
visual-system  technology  is  advancing  at  such  a  rapid  pace  that  manufac¬ 
turers  may  be  capable  of  producing  more  visual-system  fidelity  than  the 
Army  needs  or  can  afford.  As  a  consequence,  it  Is  considered  essential 
that  the  Army  initinte  a  long-term  research  effort  aimed  at  quantifying 
the  relationship  between  training  effectiveness  and  the  fidelity  of  the 
scene  produced  by  the  visual  system. 


KEY  ASSUMPTIONS 
Image  Generation 

The  components  of  a  flight  simulation  visua]  system  can  be  classi¬ 
fied  into  two  broad  categories:  image  generation  components  and  display 
components.  The  focus  and  scope  of  the  proposed  research  has  been 
influenced  by  assumptions  that  must  be  made  about  future  technological 
developments  in  both  image  generation  and  image  display. 

The  image  generators  in  current  use  are  of  two  types:  Caraera- 
Modelboard  (CMB)  systems  and  Computer  Image  Generation  (GIG)  systems. 
Although  CMB  systems  have  been  used  with  considerable  success  in 
training  some  types  of  flying  tasks  (AGARD,  19H0;  AGARD  1981),  CMB  image 
generators  have  a  number  of  Inherent  shortcomings  that  limit  their 
utility,  especially  for  use  in  training  military  flight  maneuvers  that 
occur  close  to  the  ground.  The  various  shortcomings  of  the  CMB  approach 
to  image  generation  have  been  identified  and  discussed  by  Wekwerth 


(1978),  Breglla  (1980),  and  Gullen,  Cattell,  and  Overton  (1980),  among 
others.  The  shortcomings  most  commonly  cited  include: 

a  Inadequate  depth-of-field, 

•  inadequate  image  resolution  and  clarity, 

a  restricted  roll  and  pitch, 

a  limited  size  of  gaming  area, 

a  high  cost  of  modifying  gantry,  probe,  and  modelboard, 
a  unacceptable  mechanical  lags  and  overshoots, 
a  inadequate  position  resolution, 

a  difficulty  in  producing  desired  special  effects,  such  as  weapons 
effects  and  atmospheric  attenuation, 

a  problems  resulting  from  probe  crash, 

a  inability  to  provide  additional  detail,  beyond  a  certain  point, 
as  camera  closes  on  the  modelboard, 

a  unacceptable  distortion  of  Imagery  in  the  periphery, 

a  difficulty  in  achieving  a  wide  f ield-of-vlew  while  maintaining 
adequate  brightness  and  resolution, 

a  poor  reliability  and  maintainability, 

a  difficulty  in  generating  synthetic  effects,  such  as  aim  points, 
hit  marks,  and  highways  In  the  sky, 

a  large  amount  of  space  required  to  house  modelboards,  and 

a  extensive  amount  of  energy  required  to  power  the  large  banks  of 
lights  and  the  climate  control  equipment. 

Although  contemporary  CTG  systems  also  have  a  number  of  short¬ 
comings  (for  example,  see  Gullen  et  al. ,  1980),  CIG  technology  is 

advancing  at  such  a  rapid  pace  that  many  of  the  shortcomings  are  almost 
certain  to  be  overcome  in  the  short-  to  mid-term  time  frame.  Based  on 
the  information  presently  available,  it  seems  reasonable  to  assume  that 
the  visu.al  systems  of  future  flight  simulators  will  be  built  around  a 
CIG  system.  Ocher  image  generation  techniques,  such  aa  videodisc,  film 
transparencies,  or  large-scale  CMBs ,  may  be  used  to  supplement  the. 
computer-generated  imagery  when  the  CIG  cannot  produce  imagery  that  is 
sufficient  to  train  some  types  of  Casks.  It  follows  from  these  assump¬ 
tions  that  research  to  quantify  the  relationship  between  training 
efficiency  and  visual-system  fidelity  must  focus  mainly  on  computer¬ 
generated  Imagery.  This  conclusion  has  had  a  major  Impact  on  the 
direction  of  this  research  plan. 

A  factor  constraining  research  on  required  fidelity  of  computer- 
generated  Imagery  is  the  availability  of  CTG  systems  with  which  to 
Investigate  a  wide  range  of  variations  of  the  scene  content  and  level  of 
abstraction.  A  substantial  csnability  to  investigate  the  effect  on 
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performance  of  computer-generated  image  fidelity  Is  provided  by  (a)  the 
Air  Force's  Advanced  Simulator  for  Pilot  Training  (ASPT) ,  located  at  the 
Air  Force  Human  Resources  Laboratory,  Williams  Air  Force  Base,  Arizona; 
(b)  the  Navy's  Visual  Technology  Research  Simulator  (VTRS),  located  at 
the  Naval  Training  Equipment  Center,  Orlando,  Florida;  and  (c)  an  Evans 
and  Southerland  (CT-S)  GIG  now  being  procured  by  the  Ames  Research 
Center  for  use  on  the  Rotorcraft  System  Integration  Simulator  (RSIS) . 
It  would  be  premature  to  Judge  whether  these  CIG  systems  are  capable  of 
generating,  or  could  be  modified  to  generate,  the  variations  in  scene 
content  and  level  of  abstraction  that  is  necessary  to  Investigate 
fidelity  requirements  for  the  full  range  of  helicopter  flying  tasks; 
several  of  the  proposed  research  tasks  discussed  later  will  have  to  be 
completed  before  such  a  Judgment  can  be  made.  In  any  event,  the 
proposed  research  on  visual-system  fidelity  requirements  assumes  that 
suitable  devices  or  methods  for  producing  suitable  computer-generated 
Imagery  will  be  available  when  the  time  comes  to  initiate  the  research. 
If  the  CIG  systems  Identified  above  lack  the  required  capability.  It  Is 
probable  that  new  CIG  devices  now  under  development  can  be  used  to 
generate,  perhaps  in  non-real  time,  Imagery  that  will  be  suitable  for 
research  purposes  (Csuri,  Hackathorn,  Parent,  Carlson,  &  Howard,  1979; 
Deal  &  Rue,  1980;  Dlchter,  Doris,  &  Conkling,  1980;  Spooner,  Breglla,  & 
Patz,  1980;  Schumaker,  1980). 


Image  Display 

High  quality  computer-generated  imagery  yields  no  benefits  if  the 
visual  display  component  of  the  visual  system  is  Incapable  of  presenting 
the  image  to  the  viewer  without  degrading  it  significantly,  Currently, 
the  visual  display  component  is  clearly  a  weak  link  In  the  visual 
system.  Contemporary  display  technology  is  incapable  of  presenting 
sufficiently  high  resolution  and  brightness  while  maintaining  an 
adequately  large  f leld-of-vlew.  In  addition,  visual  display  technology 
is  limited  in  Its  ability  to  simultaneously  provide  relatively  wide 
f ield-of -view  imagery  to  two  or  more  crew  members  located  several  feet 
apart  without  parallax  or  position  errors  (AGARD,  1981;  Sumlnski  i 
Hulin,  1980).  A  substantial  amount  of  work  i.s  underway  in  Industry  to 
improve  visual  display  capability.  Promising  devices  that  are  now  under 
development  or  are  being  refined  Include: 

•  CRT  projectors, 

s  laser  projectors, 

•  liquid-crystal  light  valves, 

•  oil-film  type  light  valves, 

•  tltas  light  valves, 

a  high-resolution  beam-penetration  CRTs, 

•  full-color  collographlc  displays, 

•  large  size  CRTs,  and 


•  display  optics  (Improved  optical  design  and  Improved  techniques 
for  producing  both  large  refractive  and  reflective  plastic 
optics) . 

The  plan  for  long-term  research  on  visual  systems  was  written  with 
the  assumption  that,  by  the  time  the  research  Is  Initiated,  display 
devices  will  be  available  that  have  the  capability  to  produce  a 
sufficiently  wide  range  of  relevant  design  parameters  Including  but  not 
necessarily  limited  to  the  following: 

•  fleld-of-vlew  (FOV), 

•  viewing  region, 

•  resolution, 

•  brightness, 

•  distortion, 

t  contrast, 

•  color,  and 

•  tonal  range. 

However,  one  cannot  dismiss  the  possibility  that  technological 
Innovations  may  make  It  unnecessary  to  Investigate  the  relationship 
between  performance  and  some  of  the  design  parameters.  For  instance, 
the  development  of  a  method  for  producing  a  low-cost,  hlgh-brlghtness 
display  may  make  it  unnecessary  to  Investigate  brightness  as  an 
Independent  variable. 


Fldellty/Task  Interactions 

There  is  ample  evidence  that  skill  on  some  relatively  simple 
flying  casks  can  be  acquired  effectively  with  a  very  simple  and  abstract 
display  format  (Williams  &  Flexman,  1949;  Flexman,  Matheny,  &  Brown, 
1950;  Flexman,  Townsend,  and  Ornsteln,  1954;  Creelman,  1959;  Hennessy, 
Llntern,  &  Collyer,  1981;  among  others).  Effective  training  on  other 
more  complex  flying  tasks  probably  will  require  more  complex  display 
formats,  although  there  are  currently  little  empirical  data  either  to 
support  nr  to  refute  this  claim.  As  a  consequence.  It  has  been  assumed 
that  n  sufficiently  comprehensive  research  program  must  provide  data  on 
the  relationship  between  visual-system  fidelity  and  training  effective¬ 
ness  for  each  of  a  representative  set  of  training  tasks.  It  is  further 
assumed  that  visual-system  research  on  a  given  „ta8k  cannot  necessarily 
be  gonerullred  from  fixed-wing  to  rotary-wing  aircraft.  For  instance, 
it  cannot  be  assumed  that  a  visual  system  that  provides  cost-effective 
training  on  low-level  flight  in  a  fixed-wing  aircraft  will  provide  cost- 
effective  training  on  NOE  flight  In  a  rotary-wing  aircraft. 

Research  to  optimize  the  design  of  complex  systems  is  often 
complicated  by  the  sheer  number  of  design  parameters  that  must  be 
Investigated.  Research  to  define  the  most  cost-effective  level  for 
vi.sua]  systems  Is  no  exception.  All  of  the  design  parameters  listed 
above  are  potential  Independent  variables.  In  addition,  all  the  scene 
elements  that  may  influence  tlie  content  and  level  of  abstraction  of  a 


computer-generated  scene  are  potential  independent  variables.  Tlie 
problem  is  complicated  even  further  by  the  assumption  that  the  level  of 
visual-system  fidelity  that  yields  the  most  cost-effective  training  is 
certain  to  vary  as  a  function  of  the  type  of  flying  task  being  trained 
and  the  specific  training  technique  used.  Considering  the  number  of 
parameters  Involved  and  the  levels  of  each  parameter  chat  must  be 
investigated,  it  is  clear  that  addressing  all  levels  of  all  parameters 
in  a  single,  complete-factorial  study  is  out  of  the  question.  It  has 
been  assumed  that  analytical  studies  can  be  used  to  pare  down  the 
Independent  variables  to  a  manageable  number  before  empirical  research 
is  commenced.  This  la  not  to  suggest,  however,  that  behavioral 
scientists  are  sufficiently  knowledgeable  about  human  perceptual 
processes  to  enable  them  to  define  visual-system  design  requirements 
through  analytical  considerations  alone. 


Coat  Data 

Visual-system  designers  and  users  cannot  make  Judicious  decisions 
about  how  much  fidelity  to  buy  without  knowledge  about  the  cost  of  the 
hardware,  software,  and  data  base  needed  to  produce  different  levels  of 
visual-system  fidelity.  At  the  present  time,  such  cost  data  are 
extremely  difficult  to  obtain.  It  may  be  possible  to  derive  reasonably 
accurate  estimates  of  the  cost  of  Individual  elements  of  the  display 
component  of  the  visual  system.  However,  it  is  much  more  difficult  to 
estimate  the  cost  of  CIG  systems  as  a  function  of  the  level  of  fidelity 
of  the  imagery  they  can  produce.  One  reason  for  this  difficulty  is  that 
vendors  of  CIG  systems  are  understandably  reluctant  to  release  any  cost 
data  or  technical  information  that  may  benefit  their  competitors.  A 
second  reason  is  that  neither  CIG  vendors  nor  CIG  users  have  conducted 
the  research  needed  to  identify  the  CIG  elements  that  are  the  main  cost 
drivers.  The  failure  to  have  identified  cost  drivers  is  due,  in  large 
part,  to  the  rapidly  changing  technology;  a  CIG  feature  that  is  an 
Important  cost  driver  in  one  prototype  may  be  among  the  least  important 
cost  drivers  in  the  next  prototype.  (See  Suminski  S  Hulin  [1980]  for  a 
more  detailed  discussion  of  the  problems  associated  with  developing  an 
effective  costing  model  for  CIG  systems.)  The  plan  for  long-term 
research  on  visual  systems  assumes  that  it  will  be  possible  to  compile 
the  cost  data  needed  to  develop  a  reasonably  .accurate  costing  model  by 
the  time  such  data  are  needed  to  evaluate  the  research  findings. 


RESEARCH  OBJECTIVES 

The  objective  of  the  research  on  visual-system  design  is  to 
compile  the  data  that  visual-system  designers  and  users  must  have  to 
answer  the  following  sequence  of  questions  for  each  candidate  training 
task. 

•  What  level  of  visu,il-systeni  fidelity  yields  the  most  effective 
training  on  a  given  task? 
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•  For  the  task  under  Investigation,  are  there  alternative  training 
methods  and  media,  including  training  in  the  aircraft  itself, 
that  yield  more  effective  training? 

•  Are  the  training  benefits  of  the  most  effective  training  method/ 
media  available  (simulator  or  alternative  techniques)  great 
enough  to  offset  the  cost? 

Three,  types  of  data  are  needed  to  answer  such  questions.  First, 
data  are  needed  with  which  to  quantify,  for  each  candidate  training 
task,  the  relationship  between  visual-system  fidelity  and  training 
effectiveness.  Second,  data  are  needed  with  which  to  identify  alternate 
training  techniques  (including  training  in  the  aircraft)  and  to  assess 
their  training  effectiveness.  Third,  data  are  needed  with  which  to 
assess  (a)  the  coat  of  training  the  task  in  the  flight  simulator  (for 
each  level  of  visual-system  fidelity  Investigated)  and  (b)  the  cost  of 
training  the  task  using  each  training  technique  determined  to  be  a 
viable  alternative  to  simulator  training. 


DESCRIPTION  OF  RESEARCH  PLAN:  VISUAL-SYSTEM  FIDELITY  REQUIREMENTS 

A  detailed  description  of  the  research  plan  designed  to  address 
visual-system  fidelity  requirements  is  presented  in  the  following  pages. 
It  is  important  to  note  at  the  outset  that  the  research  plan  was  not 
formulated  with  any  preconceived  notions  about  the  tasks  that  should  be 
or  should  not  be  trained  in  the  simulator.  In  particular,  it  has  not 
been  assumed  Chat  an  essential  goal  is  Co  field  a  "full  combat-mission 
simulator"  that  can  be  used  to  Crain  all  or  even  a  majority  of  the  Casks 
chat  aviators  must  master  in  their  quest  for  full  operational  readiness. 
Conversely,  the  research  plan  has  been  designed  to  cull  out  Casks  that 
should  not  be  trained  in  Che  simulator  because  (a)  a  more  cost-effective 
training  method/media  is  available,  (b)  training  the  task  in  a  flight 
simulator  would  require  an  unacceptably  large  Increase  in  the  visual- 
system's  complexity  and  cost,  or  (c)  training  the  task  in  a  flight 
simulator  would  require  a  visual-system  capability  that  exceeds  the 
existing  and  projected  atate-of-the-art. 

Without  question,  the  most  important  and  most  difficult  aspect  of 
vlsu.T  1-system  design  Ls  Che  task  of  defining  the  least  costly  CIG  scene 
content  that  will  provide  effective  training  on  a  given  task.  The 
importance  stems  from  the  fact  that,  in  the  final  analysis,  it  is  the 
scene  content^  that  dictates  the  design  requirements  for  both  the  CIG 
and  the  display  elements  of  the  visual  system.  The  difficulty  stems 

^Scene  content,  as  the  terra  is  used  here,  includes  the  full  set  of 
objects  and  features  that  may  become  visible  during  the  performance  of 
the  flying  ta.<3k(.s)  under  investigation.  Only  a  portion  of  the 
obj ects /features  that  comprise  the  scene  content  may  be  visible  on  the 
display  at  n  given  time. 


from  Che  lack  of  objective  techniques  for  bridging  the  gap  between 
training  task  descriptions  and  CIG  scene  content  specifications. 

Behavioral  scientists  who  are  knowledgeable  about  flight  simulator 
visual  systems  generally  agree  chat  far  coo  little  Is  known  about  human 
perceptual  processes  to  enable  one  to  logically  derive  the  least  costly 
CIG  scene  content  that  would  provide  effective  training  on  even  the 
simplest  flight  maneuvers  (Hennessy,  Sullivan.  &  Cooles,  1980;  Richards 
&  Dlsmukes.  1982;  Semple.  Hennessy.  Sanders.  Cross.  &  McCauley.  1981a; 
Thorpe.  1978).  Although  designers  of  contemporary  visual  systems  have 
made  what  appear  Co  be  reasonable  guesses  about  CIG  scene  content,  the 
fact  remains  that  the  design  decisions  have  been  based  more  on  Intuition 
than  known  facta  and  principles  about  human  perception  In  flight. 
Hence.  It  seems  clear  that  It  Is  not  now  possible  to  define  CIG  scene 
content  through  analytical  procedures  alone. 

A  purely  empirical  approach  to  defining  CIG  scene  content  Is  no 
more  feasible  than  a  purely  analytical  approach.  Scene  concent  and  the 
level  of  abstraction  of  a  CIG  display  can  be  varied  In  such  a  large 
number  of  different  ways  that  It  would  be  Impossible  to  investigate  the 
training  effectiveness  of  every  display  format,  even  with  the  efficient 
fflultlfactor  designs  currently  available  (see  Simon  [1973.  1977.  1981]; 
and  Simon  &  Roscoa  [1981]  for  discussions  of  the  use  of  efficient 
multifactor  designs  in  simulator  research). 

Although  CIG  scene  content  is  a  critically  important  issue, 
research  to  define  Che  fidelity  requirements  for  visual  systems  must 
also  address  the  host  of  visual-system  design  parameters  that  Influence 
Image  quality  (resolution,  contrast,  distortion,  etc.)  and  the  question 
of  f ield-of-vlew.  However,  research  to  define  the  most  cost-effective 
scene  quality  and  fleld-of-vlew  cannot  be  designed  until  one  has  a  clear 
notion  of  what  Is  to  be  displayed  and  the  tasks  that  are  Co  be  trained, 
Once  Che  tasks  Co  be  trained  and  display  content  are  known.  It  Is 
possible  that  existing  psychophysical  data,  such  as  that  compiled  by 
Kraft,  Anderson,  and  Elworth  (1980),  will  be  sufficient  to  make  judicial 
decisions  about  display  quality  and  f ield-of-vlew. 

The  above  considerations  led  to  the  formulation  of  a  research  plan 
that  employs  both  analytical  studies  and  empirical  rese.irch.  The  plan 
is  depicted  schematically  by  Che  task-flow  diagram  shown  in  Figure  3. 
Many  of  the  tasks  shown  in  Figure  3  overlap,  wholly  or  in  part,  with  one 
or  more  of  the  nine  supportive  research  areas  listed  in  Figure  2.  The 
ellipses  in  Figure  3  serve  to  Identify  the  end  products  generated  by  the 
composite  research  effort. 


Compile  List  of  Training  Tasks/CondlClons 

It  is  essential  that  this  research  effort  commence  with  a  compre¬ 
hensive  listing  of  the  Casks  that  Ai*ray  aviators  must  learn  and  the  full 
set  of  conditions  in  wlilch  aviators  must  be  able  to  perform  each  task. 


Flsure  3.  Task-flow  di,ii;rnm  for  long-term  research  on  CIG-basecl  visual 
sys  terns . 


The  cask  list  must  include  the  full  complement  of  tasks  for  every 
rotary-wing  aircraft  in  the  Army’s  inventory.  AC  the  beginning  of  the 
effort,  the  list  of  taaka/condltlons  will.be  used  in  performing  an 
information  requirements  analysis  and  will  serve  as  a  reference  in 
developing  candidate  scene-element  designs.  Subsequently,  Che  list  of 
Casks/condicions  will  be  used  Co  formulate  a  specific  plan  to  assess  Che 
relative  utility  of  candidate  visual-system  configurations. 

A  tentative  Cask  list  has  been  compiled  and  is  presented  in 
Appendix  A.  Appendix  A  lists  124  different  tasks  and  shows  the  aircraft 
types  <TH-55,  Uh-l ,  OH-SS,  CH-47,  UH-60,  AH-1 ,  AH-64 ,  and  AHIP  Scout)  in 
which  each  task  Is  performed.  Appendix  B  shows  a  tentative  listing  for 
one  aircraft  type — the  AHIP  Scout— of  the  full  set  of  conditions  under 
which  fully  trained  aviators  must  be  able  to  perform  each  task. 
Appendix  B  shows  that  a  CIG  system  for  a  full-mission  simulator  for  the 
AHIP  Scout  aircraft  must  be  capable  of  generating  (a)  day  scenes  with 
various  types  and  levels  of  atmospheric  attenuation  (haze,  fog,  smoke, 
dust,  rain,  and  snow),  (b)  night  scenes  that  vary  in  illumination  from 
full-moon  to  starlight  conditions  and  various  typas/levels  of  atmos¬ 
pheric  attenuation,  and  (c)  Che  imagery  produced  by  various  types  of 
sensors  (day  TV,  low-llght-lcvel  TV,  and  infrared)  and  optical  magnifi¬ 
cation  devices.  It  is  obvious  that  the  CIG  systems  Chat  are  capable  of 
generating  only  clear,  daytime  scenes  are  able  Co  provide  training  on 
only  a  small  fraction  of  the  visibility  conditions  that  Army  aviators 
can  be  expected  Co  encounter  in  combat. 

Identify  Visual  Information  Requlrements/Sourcas 

A  fundamental  aasuupclon  underlying  this  effort  is  that  there  is 
no  better  way  to  formulate  hypotheses  about  the  CIG  scene  content  Chat 
is  most  suitable  for  training  a  given  flying  task  Chan  to  examine  the 
visual  information  that  experienced  aviators**  employ  when  performing 
that  task  in  the  aircraft.  Accordingly,  the  purpose  of  the  task 
described  here  is  to  (a)  identify  the  visual  information  that 
experienced  aviators  employ  to  perform  each  task  under  each  of  the 
relevant  visibility  condition.s,  and  (b)  identify  the  one  or  more  sources 
of  each  type  of  Information  employed. 

As  is  discussed  in  more  detail  later  (see  page  95),  it  is  proposed 
that  data  on  visual  information  requlrements/sources  be  compiled  as  a 
part  of  a  major  effort  to  develop  a  flying-task  data  base.  It  is 
envisioned  that  these  data  would  be  more  comprehensive  and  detailed  than 
the  training  requirements  data  base  that  is  routinely  produced  in 

**11  is  not  assumed  that  aviator  trainees  employ  precisely  the  name 
visual  information  as  experienced  aviators.  However,  it  j_s  assumed 
that,  for  any  flying  task,  the  visual  information  employed  by  tralneos 
is  a  subset  of  the  visual  information  that  experts  employ. 


I 

1 


•I' 

‘I* 


I 

I 


conjunction  with  new  Army  weapons  systems.  The  following  discussion 
addresses  the  methods  and  procedures  for  compiling  the  data  on  visual 
information  requirements. 

There  are  at  least  three  methods  for  collecting  data  on  visual 
information  requirements/sources:  subjective  assessments  by  experienced 
aviators,  eye-movement  recordings,  and  experiments  In  which  visual 
information  is  systematically  varied  as  an  Independent  variable. 
Because  each  of  these  methods  has  Its  own  advantages  and  shortcomings, 
it  has  been  judged  that  all  three  are  required  to  obtain  the  data  that 
are  needed. 


Aviator  Assessments 

The  view  is  common  among  aimulation  researchers  that  the  subjec¬ 
tive  assessments  of  aviators  are  not  a  reliable  guide  to  the  visual 
Information  required  to  perform  a  specific  flying  task.  Other 
researchers,  such  as  Fender  (1982),  argue  that  a  wealth  of  valuable 
Information  resides  with  aviators  and  that  the  reported  unreliability  of 
aviators'  Judgments  reflects  inadequate  methods  for  tapping  this  data 
source,  Inadequate  methods  for  analyzing  the  data,  or  true  differences 
In  aviators'  perceptual  strategies.  The  authors  of  this  research  plan 
share  Fender's  views  about  the  potential  value  of  experienced  aviators' 
subjective  assessments  and  believe  that  effective  procedures  can  be 
developed  to  obtain  valid  and  useful  data  from  them. 

Much  of  the  difficulty  in  obtaining  valid  information  from 
aviators  stems  from  the  aviators'  lack  of  understanding  of  the  complex 
questions  they  are  asked,  the  small  amount  of  time  they  are  typically 
given  to  reflect  on  the  questions,  and  the  lack  of  the  vocabulary  and 
the  concepts  needed  to  express  their  views  concisely.  To  counter  these 
problems,  It  Is  proposed  that  a  team  of  at  least  six  experienced 
helicopter  aviators  be  assigned  to  this  project  full  time  for  a  period 
of  about  six  months  and  that  tho  aviators  be  given  training  on  at  least 
the  following  topics  before  they  are  asked  to  provide  information  about 
information  requirements  and  sources: 


•  research  objectives  and  plans, 

e  anatomy  and  functioning  of  the  human  eye, 

•  known  principles  of  human  perception  in  flight, 

•  known  or  probable  variability  among  aviators 
types/sources  of  visual  information  employed,  and 

•  methods/principles  of  ratlng/scallng . 


in  the 


The  first  thing  the  aviators  will  be  required  to  do  after  their 
initial  training  is  (n)  to  identify,  for  each  task/conditlon,  the 
fiubtasks  for  which  performance  is  dependent,  wholly  or  in  part,  on 
extra-cockpit  visual  information,  and  (b)  to  define  performance 
standards  for  each  of  the  relevant  subtaaks.  A  group  decision-making 


technique,  such  as  the  Consensual  Decision-Making  Technique  (Delbecq, 
Van  de  Van,  &  Rustafson,  1975),  will  be  uned  to  accomplish  thia  task. 
The  "subtask"  will  be  the  unit  of  further  analyses.  The  performance 
standards  serve  as  an  Index  of  the  precision  with  which  vision-based 
decisions  must  be  made, 

The  next  task  that  must  be  performed  by  the  team  of  aviators  is  to 
identify  the  type,  source,  and  relative  Importance  of  visual  Information 
used  in  accomplishing  each  subcaak  for  which  some  amount  of  extra- 
cockpit  information  is  necessary.  In  order  to  accomplish  the  objectives 
of  this  task.  It  will  be  necessary  to  develop  and  validate  better 
research  methods  than  the  ones  that  are  presently  available;  the  new 
research  methods  must  be  more  systematic  and  must  be  specifically 
tailored  to  provide  the  type  of  information  needed  to  formulate 
hypotheses  about  CIG  scene  content.  The  development  and  validation  of 
suitable  methods  will  require  far  more  time  than  was  available  for 
developing  this  research  plan.  However,  some  thought  has  been  given  to 
the  shortcomings  of  existing  methods  and  to  the  attributes  of  a  more 
suitable  methodology. 

Heretofore,  visual  Information  requirements  typically  have  been 
defined  in  terms  of  the  critical  flight  parameters  that  must  be  judged 
and  In  terms  of  the  classical  visual  cues  to  depth  and  locomotion  that 
provide  information  about  the  momentary  value,  or  change  in  value,  of 
the  relevant  flight  parameters.  (For  examples  of  visual  cue  requirement 
analyses  or  research,  see  Coward  &  Rupp,  1982;  Elsele,  Wllligea,  & 
Roscoe,  1976;  Gibson,  1966,  1979;  Gullen  et  al.,  1980;  Harker  &  Jones, 
1980;  Oskaptan,  1975;  Roscoe,  1977;  Rue,  Cyrus,  Garnett,  Nachbar,  Seery, 
&  Starr,  1980;  and  Stark,  1977.)  While  visual  cue  requirements  studies 
are  not  without  value,  the  results  lack  the  specificity  needed  tp  make 
confident  and  specific  judgments  about  the  least  costly  CIC  scene 
content  for  each  of  a  number  of  flying  tasks.  Furthermore,  conclusions 
drawn  from  the  analysis  of  visual  cue  requirements  are  sometimes 
erroneous  or  misleading.  For  instance,  Stevens  (1980)  has  pointed  out 
the  error  In  the  Intuitive  conclusion  drawn  by  some  researchers  (Gibson, 
1930;  Purdy,  1960)  that  texture  density  is  a  crucial  depth  cue.  Stevens 
expliiins  that  since  texture  density  is  n  joint  function  of  viewing 
distance  and  tlie  slant  of  the  viewed  surface  relative  to  the  viewer,  one 
cannot  separate  the  relative  contributions  to  the  texture  density 
gradient  of  foreshortening  ond  distance.  This  ambiguity  has  been 
demonstrated  empirically  by  Newman  (1972). 

Described  below  are  some  attributes  that  should  be  considered  when 
developing  a  methodology  for  obtaining  useful  information  from  the  group 
of  experienced  aviators  concerning  the  type,  source,  and  relative 
importance  of  visual  information.  Most  of  these  attributes  are  aimed  at 
providing  structure  and  specificity  to  the  difficult  job  of  intro¬ 
specting  about  how  complex  flying  tasks  are  performed. 

Small  unit  of  analysis.  One  of  the  reasons  that  it  is  difficult 
to  formulate  .accurate  statements  about  extra-cockpit  visual  requirements 
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In  terns  of  aircraft  flight  parameters  and  standard  metrics;  his  actual 
requirement  Is  for  the  visual  Information  he  can  use  to  Judge  the 
present  and  projected  distance  between  his  aircraft's  main/tall  rotor 
and  obstacles  in  the  Immediate  environment. 

Judgment  precision.  An  Important  aspect  of  visual  information 
requirements  Is  the  precision  requirements  for  Judgments  that  must  be 
based  solely  on  extra-cockpit  information.  Without  such  information  it 
Is  easy  to  require  more  accurate  information  from  a  CIG  display  than  can 
be  gleaned  from  the  actual  extra-cockpit  scene.  A  cursory  examination 
of  the  visual  requirements  for  performing  a  standard  autorotation  may 
suggest  that  aviators  must  be  capable  of  extremely  accurate  Judgments  of 
altitude  throughout  the  maneuver.  However,  a  careful  examination  of  the 
prescribed  method  for  performing  a  standard  autorotation  indicates  that 
the  only  critical  altitude  judgments  that  must  be  based  on  the  extra- 
cockpit  scene  alone  are  (a)  the  judgment  of  when  altitude  has  decreased 
to  between  75  and  100  feet  (introduce  cyclic  control  to  decrease  speed) 
and  (b)  the  Judgment  of  when  altitude  has  decreased  to  between  10  and  15 
feet  (apply  sufficient  collective  to  minimize  rate  of  descent  and  ground 
speed).  Hence,  there  is  no  need  for  great  precision  In  Judging  altitude 
from  extra-cockpit  cues  throughout  the  performance  of  a  standard 
autorotation. 


Objective  Research  on  Visual  Information  Requirements 

Aviators'  subjective  assessments  can  be  used  to  obtain  visual 
information  requirements  data  on  a  great  many  different  tasks  and 
conditions  in  a  relatively  short  period  of  time  and  at  relatively  low 
cost,.  However,  pilot  Judgments  cannot  be  expected  to  yield  data  that 
are  sutflclently  comprehensive  and  detailed.  For  instance,  it  is 
unlikely  that  aviators  will  be  able  to  Introspect  accurately  about 
(a)  the  information  they  obtain  through  peripheral  vision,  (b)  the 
length  of  time  their  eyes  must  remain  fixated  on  relevant  objects  or 
areas  in  the  visual  scene,  or  (c)  conditions  in  which  the  information 
that  can  be  gleaned  from  the  extra-cockpit  scene  is  inadequate  and  must 
be  supplemented  by  information  from  cockpit  instruments.  It  Is  for  this 
reason  that  the  aviator  assessments  must  be  supplemented  by  objective 
research. 

A  substantial  amuunt  of  time  and  study  will  be  needed  to  make 
final  decisions  about  the  objective  research  that  must  be  performed  to 
supplement  and  validate  aviators'  judgments  about  visual  information 
requirements.  The  four  lines  of  research  described  below  represent  a 
current  "best  guess"  about  the  type  of  research  that  may  prove  fruitful. 
All  four  lines  of  research  are  designed  to  yield  data  on  performance  in 
the  aircraft.  This  reflects  the  general  belief  that  investigating 
in-alrcraft  performance  minimizes  the  chances  of  drawing  invalid 
conclusions  about  visual  Information  requirements.  This  is  not  to  say, 
however,  that  research  on  some  que.stions  about;  visual  information 
requlremencs  might  better  be  conducted  in  a  laboratory  setting. 
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Investigation  of  eye  movements/fixations.  The  premise  underlying 
the  recording  of  aviators'  eye  movements  is  that  data  on  aviators'  scan 
patterns  and  fixation  points  can  be  used  to  draw  valid  Inferences  about 
the  visual  information  requirements  that  can  be  fulfilled  with  foveal 
vision,  A  brief  review  of  the  literature  on  eye-movement  recording  of 
aviators  precedes  a  description  of  the  eye-movement  research  that  is 
proposed. 

In  a  comprehensive  review  of  eye-movement  recording  methods,  Young 
and  Sheena  (1975)  report  that  attempts  to  record  eye  movements  date  back 
to  the  early  1920s.  The  earliest  attempts  to  record  aviators'  eye 
movements  used  filming  techniques  to  record  eye  fixations  on  cockpit 
instruments  during  both  instrument  and  visual  flight  conditions  (Fitts, 
Jones,  i  Milton,  1950;  Jones,  Milton,  &  Fitts,  1950;  Milton,  Jones,  & 
Fitts,  1949,  1950;  Milton,  McIntosh,  &  Cole,  1951,  1952;  McGhee,  1943; 
Milton  4  Wolfe,  1952). 

The  recording  of  extra-cockpit  eye  fixations  had  to  await  the 
development  of  more  sophisticated  equipment.  The  corneal  reflection 
technique,  pioneered  by  Mackworth  and  Thomas  (1963),  has  been  used  to 
develop  eye-movement  recording  devices  that  generate  films  or  video 
recordings  that  show  the  scene  being  viewed  and  the  point  of  instan¬ 
taneous  aye  fixation  in  the  scene. 

Such  devices  have  been  used  successfully  to  record  rotary-wing 
aviators'  intra-  and  extra-cockpit  eye  fixations  during  flight.  Barnes 
(1970,  1972)  recorded  rotary-wing  aviators'  eye  fixations  during  a 
20-mlnute  flight  that  Involved  11  different  maneuvers:  takeoff,  hover 
(In-ground-effect) ,  vertical  climb,  cruise,  standard  rate  turn,  non¬ 
vertical  climb,  180®  turn,  steep  approach,  hover  (outrof-ground  effect), 
vertical  descent,  and  landing.  All  maneuvers  except  takeoff,  hover  (in- 
and  out-of-ground-effect),  and  landing  were  performed  with  Instruments 
only.  A  Westgate  Model  EMC-2  Eye-Movement  camera  was  used  to  perform 
this  research. 

More  recently,  a  NAG  I  Mark  Recorder  and  a  Photo-Sconic  high  speed 
motion  picture  canorn  have  been  used  successfully  by  L’R  Army  Aeromedical 
Research  Laboratory  personnel  to  study  helicopter  workload  (Sinrnons, 
Kimball,  &  Diar.,  1976),  helicopter  copilot  workload  (Cote,  Krueger,  4 
Simmons,  1982),  scanning  techniques  of  Coast  Guard  helicopter  lookouts 
(Blackwel.l,  Simmons,  4  Watson,  1982),  and  sources  of  vl.sunl  flight 
information  (Marker  4  Jones,  1980). 

Although  the  above  referenced  research  clearly  confirms  the 
feasibility  and  utility  of  eye-movement  recording  as  a  technique  for 
defining  aviators'  visual  information  requirements,  the  composite  of 
research  data  on  eye  movements  of  helicopter  crewmen  cover  only  a 
limited  number  of  flying  tasks  and  conditions.  In  short,  the  eye- 
movemonr  data  presently  available  have  little  value  for  use  in  defining 
CIG  scene  content  for  an  adequate  range  of  flight  tasks  and  conditions. 
The  equipment  and  procedures  developed  previously  represent  the  main 
benefit  to  be  derived  from  previous  research. 
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The  collection  of  eye-movament  data  for  every  flying  Cask  and 
condition  listed  in  Appendices  A  and  B,  respectively,  is  neither 
feasible  nor  necessary.  Ra.thftr,  it  la  envisioned  that  eye-movement  data 
would  be  collected  on  a  small  sample  of  flying  tasks/conditions  for  one 
of  three  purposes.  The  first  purpose  is  to  provide  a  means  for 
validating  aviators'  subjective  assessments  of  visual  information 
requirements.  Once  members  of  the  team  of  aviators  have  completed  their 
assessment  of  the  types  and  sources  of  information  required  to  perform 
several  tasks,  eye-movement  recordings  made  during  the  performance  of 
those  tasks  would  provide  information  with  which  to  evaluate  the 
validity  of  the  aviators'  subjective  assessments.  Gross  inconsistencies 
between  eye-movement  data  and  pilot  assessments  would  signal  a  need  to 
reexamine  (a)  the  procedures  used  to  tap  aviators'  opinions  about  visual 
information  requirements,  (b)  the  assumption  that  pilot  opinion  is  a 
valid  and  reliable  source  of  data  on  visual  information  requirements, 
and  (c)  the  assumption  that  eye  movements  and  fixations  constitute  a 
valid  and  reliable  source  of  data  on  visual  information  requlcementa. 

The  second  purpose  to  be  served  by  eye-movement  recordings  is  to 
obtain  information  on  (a)  tasks/condiClons  Chat  aviators  have 
experienced  ao  Infrequently  that  thoy  have  no  strung  opinions  about 
visual  information  requirements/sources,  and  (b)  tasks/condltions  that 
are  Inherently  difficult  to  evaluate  through  introspection,  Within  this 
context,  examples  of  tasks/conditions  that  are  likely  to  qualify  for 
eye-movement  study  are  operations  over  snow,  operations  in  heavy  smoke, 
operations  in  weather  conditions  that  degrade  visibility  (fog,  snow,  low 
cloud  ceiling),  daytime  NOE  navigation  in  a  variety  of  topography,  and 
nighttime  NOE  flight  and  navigation.  Existing  eye-movement  recording 
systems  have  been  developed  for  use  during  conditions  of  relatively  high 
Illumination.  Hence,  in  order  to  Investigate  the.  tasks  listed  above,  it 
will  be  necessary  to  design  devices  that  provide  the  capability  to 
record  eye  movements  during  darkness  and  other  conditions  of  reduced 
visibility. 

The  third  use  of  eye-movement  recordings  is  to  provide  more 
quantitative  data  than  can  be  obtained  from  Che  subjective  assessments 
of  aviators.  A  need  may  arise  for  such  data  as  fixation  frequency  and 
duration  for  different  classes  of  features,  time  spent  seiurching  the 
extra-cockpit  scene,  the  frequency  with  which  aviators  fixate  on  objects 
in  different  segments  of  the  f ield-of-viev?,  and  link  values  that  depict 
aviators'  search  patterns.  Such  data  can  be  obtained  only  from  the 
study  of  eye-movement  recordings. 

Investigation  of  the  role  of  peripheral  vision.  Helicopter  avia¬ 
tors'  use  of  peripheral  vision  has  important  Implications  for  both  CIG 
design  and  the  design  of  the  display  component  of  the  visual  system. 
The  aviator  .nssessment  data  and  the  eye-movemant  data,  together,  should 
provide  a  relatively  clear  notion  of  the  visual  information  requirements 
that  .ire  fulfilled  with  foveal  vision.  However,  thnse  methods  cannot  be 
expected  to  provide  data  that  are  useful  in  drawing  Infererices  about  Che 
Information  requirements  fulfilled  through  peripheral  vl.slon. 


Daca  on  aviators'  use  oE  peripheral  vision  during  flight  would  be 
of  value  in  specifying  the  minimum  f leld-of-view  for  flight  simulators 
and,  perhaps,  in  specifying  the  characteristics  of  the  scene  to  be 
viewed  peripherally.  Such  data  would  be  of  particular  value  in 
clarifying  the  role  of  peripheral  vision  during  darkness  and  other 
conditions  of  reduced  visibility. 

It  seems  probable  that  useful  insights  about  the  function  and 
importance  of  peripheral  vision  can  be  obtained  by  examining  aviators' 
performiance  on  selected  flying  tasks  when  different  areas  of  the 
aviator's  f ield-of-vlew  have  been  occluded.  One  method  developed  to 
occlude  an  aviator's  f ield-of-view  is  to  place  on  the  inside  of  the 
aircraft  canopy  an  orange  film  that  is  transparent  when  viewed  by  the 
naked  eye,  but  opaque  when  viewed  through  a  blue  visor  (Yeend  &  Carico, 
197fi;  Yeend,  Watkins,  Carico,  &  Palmer,  1978),  This  technique  enables 
rhe  safety  pilot  the  full  f ield-of-viaw  while  occluding  portions  of  the 
subject's  f ield-of~viciw.  This  technique  is  not  ideal  for  Investigating 
the  importance  of  peripheral  vision  because  there  in  no  way  to  determine 
the  information  within  the  reduced  fleld-of-view  that  is  being  processed 
peripherally.  The  fiald-of-view  would  have  to  be  very  small  indeed  to 
eliminate  all  indications  of  optic  flow.  In  addition,  It  would  be 
difficult  to  eliminate  variations  In  visual  information  resulting  from 
aviators'  head  movements. 

What  appears  to  be  a  better  technique  Is  to  develop  contact  lenses 
that  are  opaque  in  the  desired  areas.  With  this  technique,  the  portion 
of  the  retina  that  Is  occluded  would  remain  constant  regardless  of  the 
aviator's  head  and  eye  movements.  It  is  technically  feasible  and  would 
not  be  prohibitively  costly  to  develop  sots  of  contact  lenses  to  occlude 
central  vision  and  to  occlude  different  amounts  and  locations  of 
peripheral  vision. 

Investigation  of  the  Impact  of  Image  quality.  In  Che  past,  there 
has  been  a  continuing  effort  to  improve  the  image  quality  of  simulator 
visual  systems — despite  the  fact  that  there  is  no  body  of  data  with 

wlUch  to  qunntify  the  relationship  between  image  quality  and  training 
effectiveness.  Tliu  tendency  has  been  to  establish  requirements  for 
image  quality  by  examining  the  one  or  two  training  tasks  that  require 
the  highest  quality  Image.  Kor  example,  arguments  for  the  need  for  a 

very  high  resolution  visual  system  have  been  based  on  the  resolution 

needed  to  train  such  tasks  as  target  detection  and  identification.  In 
addition,  the  quest  for  Increased  image  quality  undoubtedly  has  been 
influenced  by  the  generalized  desire  for  displays  that  are  more 

realistic  and  more  esthetically  pleasing. 

Controlled  laboratory  studies  will  be  required  to  collect  the  type 
of  data  needed  to  establish  the  most  cost-effective  image  quality  for 
the  various  flying  tasks  that  are  to  be  trained  in  the  simulator. 
However,  it  Is  possible  to  gain  useful  insights  about  image  quality 
requirements  through  studies  in  the  aircraft.  A  methodology  for  such 
studies  has  been  suggested  by  a  Working  Group  sponsored  by  the  Flight 
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Mechanics  Panel  of  AGARD  (AGARD,  1981,  p.  66).  The  idea  set  forth  by 
the  Working  Group  is  that  information  about  the  minimum  image  quality 
can  be  obtained  by  measuring  the  effect  on  flying  performance  of  special 
eye  glasses  that  degrade  the  real-world  visual  scene  in  various  ways. 
It  would  be  a  relatively  simple  matter  to  produce  sets  of  eye  glasses 
that  could  be  used  to  systematically  vary  effective  brightness  and 
color. 


It  is  proposed  that  such  a  ?:'udy  be  designed  and  conducted. 
Ideally,  the  study  would  investigate  the  effect  of  image  quality  on  both 
the  performance  of  skilled  aviators  and  the  rate  of  skill  acquisition  of 
aviator  trainees.  Moreover,  the  study  should  investigate  the  effect  of 
image  quality  on  a  representative  set  of  flying  tasks  that  cover  the 
full  range  of  complexity  and  visual  information  usage. 


Investigation  of  the  role  of  stereopsis.  Measures  of  stereo 

acuity  recorded  in  the  literature  varies  from  two  seconds  of  arc  (Berry, 
1948)  to  24  seconds  of  arc  (Graham,  Riggs,  Mueller,  &  Solomon,  1949). 
Using  a  stereo  acuity  value  of  24  seconds,  Stevens  (1982)  computed  that 
the  eye  is  sensitive  to  retinal  disparity  out  to  roughly  1600  feet. 
Most  researchers  have  concluded  that  stereopsis  does  not  contribute 
significantly  to  low-level  flight  in  high-speed,  fixed-wing  aircraft 
because  of  the  small  amount  of  time  objects  remain  in  the  stereoscopic 
zone  (two  seconds,  assuming  a  speed  of  500  knots,  an  altitude  of  100 
feet,  and  a  stereo  acuity  of  12  seconds  of  arc). 


However,  this  rationale  cannot  be  used  to  dismiss  stereopsis  as  an 
important  cue  for  helicopter  operations.  Most  of  the  helicopter 
maneuvers  that  are  difficult  to  master  occur  at  low  speeds  and  at  low 
altitudes.  Nap-of-the-earth  flight  represents  the  extreme  case; 
Ozkaptan  (I97.'i)  reports  that  the  aviator's  maximum  viewing  range  during 
NOE  flight  seldom  exceeds  3000  feet.  Sinacorl  estimates  that  the 
"immediate  radius  of  concern"  to  an  NOE  aviator  extends  only  to  about 
550  feet  at  the  highest  expected  NOE  speed  of  100  kts  (Sinacorl,  1983, 
p.  66) .  In  many  Instances,  the  objects  in  the  visual  scene  that  are  of 
primary  importance  to  the  pilot  are  located  within  ICO  feet  of  the 
aviator's  eye.  Hence,  there  are  reasons  to  believe  that  proficiency  for 
many  flying  tasks  may  be  ilependcnt  on  stureop.sls,  Tf  performance  on 
some  task.s  in  the  aircraft  is  importantly  influenced  by  sCereop.sls,  it 
is  conceivable  that  training  such  tasks  In  a  simulator  without  a 
stereoscopic  displav  may  result  in  negligible  or,  conceivably,  negative 
trans£er-of-tralning  to  the  aircraft.^  Cost  considerations  would 
probably  prevent  the  development  and  use  of  stereoscopic  GIG  display.s. 


^Based  upon  the  composite  information  presently  available,  it  seems 
improbable  that  a  stereoscopic  display  i.s  essential  for  simulator 
training  of  any  helicopter  flying  task.  However,  the  data  on  this 
issue  nn.'  by  no  means  conclusive,  and  there  are  some  who  believe  that 
resources  .should  be  expended  to  develop  stereoscopic  displays  for 
helicopter  simulators. 
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So,  the  only  opClon  would  be  to  make  no  attempt  to  train,  In  a  flight 
simulator,  tasks  for  which  performance  Is  heavily  dependent  upon 
stereopsls. 

The  Impact  of  stereopsls  on  flying  proficiency  could  be  assessed 
effectively  and  Inexpensively  by  comparing  trained  aviators'  performance 
on  selected  flying  tasks  under  binocular  and  monocular  viewing  condi¬ 
tions.  Although  more  costly  and  difficult,  other  studies  could  be 
conducted  to  assess  the  Impact  of  stereopsls  on  rate  of  skill  acquisi¬ 
tion  and  transfer-of-tralnlng.  Such  studies  would  require  that  two 
groups  of  student  aviators  be  trained,  one  under  monocular  and  the  other 
under  binocular  viewing  conditions.  If  it  is  found  that  skill  Is 
acquired  more  slowly  by  the  group  initially  trained  under  monocular 
viewing  conditions,  this  group  could  be  switched  to  binocular  viewing 
conditions  and  data  compiled  on  the  amount  of  additional  training 
required  to  achieve  the  level  of  proficiency  exhibited  by  the  group 
trained  throughout  under  binocular  viewing  conditions.  The  data  from 
such  experiments  would  serve  to  identify  flying  tasks  for  which 
stereopsls  Is  important  (if  any)  and,  thereby,  flying  tasks  that  may  not 
be  amenable  to  training  In  a  flight  simulator  that  Is  not  equipped  with 
a  stereoscopic  display. 


Rate  Skill  Loadings  by  Task/Condltlon 

It  is  convenient  to  think  of  each  flying  task  as  having  three 
skill  components:  a  perceptual  component,  a  cognitive  component,  and  a 
motor  (aircraft  handling)  component.  Knowledge  of  the  relative  diffi¬ 
culty  of  these  three  components  is  essential  for  the  design  of  effective 
CIG  display  formats  and  effective  instructional  strategies.  In  rating 
what  is  referred  to  in  Figure  3  as  "skill  loadings,"  It  is  not 
sufficient  to  consider  only  the  inherent  difficulty  of  the  three  task 
components.  In  addition,  the  ratings  must  take  into  account  the  skills 
that  the  student  aviators  possess  at  the  time  they  commence  receiving 
instruction  on  the  task  in  question.  This  means  that  the  relative 
difficulty  of  the  three  skill  components  for  n  given  task  will  vary  as  a 
function  of  the  SGqvience  in  which  flying  tasks  are  taught. 

For  instance,  consider  the  relative  skill  loadings  for  Che  Cask 
"hovering  in  ground-effect  (IGE)"  and  the  task  "hovering  out-of-ground- 
effect  (OGE)."  At  the  time  a  student  first  receives  instruction  on  IGE 
hover,  ha  possesses  all.  or  most  of  the  perceptual  skills  needed  to 
detect  vertical  and  translational  deviations  from  the  desired  hover 
position.  However,  a  substantial  amount  of  training  is  required  for  him 
to  acquire  the  aircraft  handling  skills  required  to  null  the  deviations. 
After  the  student  has  mastered  IGE  hover,  he  is  given  training  on  OGF. 
hover.  Ac  the  time  the  student  commences  his  training  on  OGE  hover,  he 
possesses  the  cognitive  skills  and  the  aircraft  handling  skills  (motor 
skills)  he  needs  to  perform  this  task  but  lacks  the  perceptual  skills  he 
needs  to  detect,  from  a  higher  altitude,  vertical  and  translational 
dcvi.atlons  from  the  desired  hover  position. 


With  such  knowledge  about  relative  skill  loading  on  various  flying 
tasks,  it  is  easy  to  conceive  of  CIG  display  formats  and  instructional 
strategies  that  may  facilitate  the  learning  of  the  difficult  perceptual 
components.  For  Instance,  the  rate  of  skill  acquisition  wight  be 
increased  by  bypassing  the  aircraft  equations  of  motion  and  providing 
Che  student  with  a  simple  positional  control  wxCh  which  to  null  a  simple 
forcing  function  that  causes  the  aircraft  Co  drift  from  Che  desired 
hover  position.  Under  this  condition,  the  student  could  focus  all  his 
attention  on  the  perceptual  component  of  the  cask. 

The  failure  to  consider  the  relative  difficulty  of  skill  compo>- 
nants  in  the  manner  described  above  can  lead  to  erroneous  conclusions 
about  how  best  to  train  students  to  perform  a  given  Cask,  For  instance, 
some  simulator  designers  have  examined  the  skills  required  to  perform 
NOE  flight  and  have  concluded  that  this  cask  represents  the  ultimate  In 
perceptual  and  aircraft  handling  difficulty.  Although  NOE  flight  does 
indeed  require  a  high  level  of  perceptual  and  aircraft  handling  skill, 
aviators  possess  a  high  level  of  such  skills  at  the  time  they  begin 
their  training  on  NOE  flight.  Experienced  aviators  claim  that  naviga¬ 
tion*  a  cognitive  skill,  Is  Che  most  difficult  component  of  NOE 
operations.  If  this  Is  true,  Increased  instruction  on  NOE  navigation 
and  decreased  Instruction  on  NOE  flying  (In  a  simulator  or  in  an 
aircraft)  may  be  called  for. 

The  ratings  of  skill  loadings  should  be  performed  by  a  team 
composed  of  highly  experienced  aviators  and  behavioral  scientists  who 
are  knowledgeable  about  helicopter  flying  operations,  task/skill 
requirement  analysis,  and  training.  The  team  of  aviators  selected  Co 
define  visual  information  requirements  and  sources  should  be  highly 
qualified  to  make  skill  component  ratings  once  they  have  completed  their 
deliberations  on  visual  information  requirements  and  sources.  However, 
to  ensure  reliable  ratings,  the  team  should  be  supplemented  by  another 
six  to  10  aviators. 


Special  Comment 

The  ultimate  aim  of  the  four  tasks  that  roLlov  is  to  formulate 
hypotheses  about  CIG  display  formats^  that  may  prove  effective  in 
training  helicopter  aviators.  The  comments  presented  below  discuss  some 
of  Che  problems  "associated  with  specifying  sultoble  display  formats  and 
ways  to  deal  with  these  problems. 

The  literature  contains  little  information  of  value  in  specifying 
the  elements  that  should  be  present  in  a  CIG  scene  for  helicopter 
aviator  training  or  the  manner  in  which  these  elements  should  be 

^The  term  "display  format,"  as  used  here,  encompasses  botli  the  type  of 
features  that  appear  in  ttie  scene  and  the  level  of  alistract  ion  of  the 
feature's  portrayal. 


designed.  The  established  principles  of  human  perception  are  too 
general  to  provide  a  basis  for  the  analytical  derivation  of  specifi¬ 
cations  for  scene  content  and  element  design;  and,  the  small  amount  of 
research  in  which  scene  content  and  element  design  have  been  investi¬ 
gated  as  an  Independent  variable  has  dealt  with  flxed-wlng  aircraft 
flying  casks,  such  as  carrier  landings  (Westra,  1982;  Westra,  Simon, 
Collyer,  &  Chambers,  1982)  and  high-speed  terrain  flight  (Buckland, 
1980).  The  extent  to  which  the  findings  of  such  studies  can  be 
generalized  to  helicopter  operations  is  questionable,  at  best,  The  net 
result  Is  that  the  design  of  display  formats  for  use  in  training 
helicopter  aviators  must  start,  very  nearly,  at  square  one. 

Researchers  who  have  considered  CIG  scene  content  agree  that  there 
are  no  generally  accepted  procedures  for  defining  optimal  scene  content 
or  the  optimal  design  of  scene  elements  (Hennessy  et  al,  1980;  Semple  et 
al.,  1981a;  Thorpe,  1978,  among  others).  The  procedures  suggested  below 
are  heavily  dependent  upon  Intuition  and  Innovation  to  develop  candidate 
display  format.  Although  the  enormous  number  of  combinations  of  display 
elements  and  element  designs  necessitate  the  use  of  Intuition  and 
analytical  study,  no  firm  conclusions  will  be  drawn  until  the  candidate 
display  formats  have  been  submitted  to  empirical  tests. 

Before  any  meaningful  effort  can  be  expended  In  developing 
candidate  scene  designs  and  candidate  scene-element  designs,  it  will  be 
necessary  to  formulate  specific  assumptions  about  the  capabilities  of 
the  visual  system  to  be  used  in  evaluating  the  scene-element  designs. 
Specifically,  it  will  be  necessary  to  formulate  assumptions  about  (a) 
the  design  characteristics  of  the  CIG  system,  (b)  the  content  and  format 
of  the  CIG  data  base,  (c)  the  methods  and  procedures  by  which  the  data 
base  Is  compiled,  and  (d)  the  characteristics  .of  the  display  subsystem. 
Together,  these  four  factors  dictate  the  capabilities  and  constraints 
for  scene-element  design. 

Although  the  display  subsystem  is  no  less  Important  than  the  other 
portions  of  tlie  visual  system,  display  technology  is  changing  less 
rapidly  and  has  less  of  an  impact  on  visual-system  costs  than  the 
ti'chnology  bi'.iring  on  I’lG  desilgn  and  data-base  generation  methods.  So, 
it  is  antlcipuLud  that  the  greatest  uncertainty  and  risk  will  be 
associated  witli  deciding  upon  the  CIG  and  data-base  capabilities  that 
are  to  bo  assumed . 

<1 

The  most  modern  CIG  systems  In  the  government's  inventory  are  by 
no  mcrins  obsolete,  but  technology  now  under  development  promises 
.significant  .idv.ances  in  CIG  technology  within  the  next  two  to  five 
years.  It  is  altogether  possible  that  by  the  time  the  research  on 
scene-content  and  scene-element  designs  Is  Initiated,  significant 
technological  breakthroughs  will  be  imminent  but  not  yet  Incorporated 
into  an  oper.i  t iona  1  device.  Truly  major  technological  advonces  In  CIG 
or  drita-ba.su  technology  may  justify  delaying  the  ro.search  until  a 
.statc-of-tlu’-.-irt  CIG  can  be  procured.  Or,  it  may  be  possible  to  develop 
terlin  Iquc.s  for  producing,  in  non-real  time,  imagery  that  could  be  used 


V. 


Co  evaluate  scene-conCent  and  scene-eleracnt  designs  chac  Che  new 
technology  will  be  capable  of  generating. 

The  primary  goal  of  moat  of  the  recent  advances  in  CIC  technology 
has  been  to  increase  the  number  of  edges  or  polygons  that  are  available 
for  use  in  creating  scene  elements.  Increases  in  edge  capacity  have 
been  achieved  through  improved  system  architecture  and  through  improved 
microelectronic  components  that  provide  for  greater  computational  speed 
and  better  on-line  and  off-line  memory  utilization  (see.  for  examplet 
nichtori  DorlSi  and  Conkling,  1980;  Schumaker,  1980;  Spooner.  Breglia, 
and  Patz,  1980).  In  1979,  Cohen  (1979)  predicted  that  CIG  systems 
capable  of  producing  as  many  as  100,000  edges  In  real-time  would  be 
available  by  the  mid  80's.  Cohen's  prediction  of  large  increases  in 
edge  capacity  has  not  yet  been  realized;  contemporary  CIC  systems  are 
capable  of  producing  only  about  8,000  edges  in  real-time.  Gullen  and 
his  colleagues  (Gullen  et  al.,  1980)  share  the  view  that  all  contempo¬ 
rary  CIG  systems  employ  the  same  general  design  approach  and  that  this 
design  approach  has  intrinsic  limits  to  growth.  They  believe  that 
refinements  could  increase  the  edge  capacity  by  a  factor  of  two  or 
three,  but  that  altogether  new  approaches  will  be  required  to  achieve 
larger  increases  in  CIG  capacity. 

Since  scene-element  design  is  so  heavily  dependent  upon  CIC  and 
data-base  characteristics,  an  attempt  has  been  made  to  identify  techno¬ 
logical  innovations  that  may  have  a  major  influence  on  the  design  of 
future  CIG  systems.  More  information  about  the  technological  innova¬ 
tions  can  be  found  in  ths  references  cited  in  the  following  paragraphs. 


Curved  Surfaces  as  the  Modeling  Unit 

Until  recently,  the  basic  modeling  unit  has  been  edges  or 
polygons.  Work  now  underway  suggests  that  the  curved  surface  is  a  far 
more  efficient  modeling  unit  than  the  edge  or  polygon.  Gardner  and  his 
assocl.ites  have  developed  an  appro.ach  that  uses  quadratic  surfaces  as 
the  modeling  unit  along  with  up  to  six  planar  surfaces  to  bound  a  single 
quadr.ntlc  surface  (Cardner,  narlln,  f-  (lelinan,  1981;  Gardner  J 
Gcr.sliowitz ,  1  982;  Gardner  i  Golman,  1982;  Van,  1980).  A  similar 

approach  reported  by  Soland,  Voth,  and  Narendra  (1981)  employs  tlie 
"bicubic  patch"  as  the  basic  modeling  unit.  Modeling  both  man-made  and 
cultural  features  with  curved  surfaces  as  Che  ba.sic  modeling  unit  is 
much  simpler  than  using  edges  because  very  few  parameters  are  required 
to  define  a  curved  surface.  Moreover,  a  more  faithful  facsimile  of  man^' 
objects  can  be  achieved  with  curved  surfaces  than  with  rectilinear 
surfaces.  This  is  a  partlculai.  ly  important  advantage  in  modeling 
terrain  relief  from  the  Defense  Mapping  Agency  (DMA)  source  data. 
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Texture  Generation 


Texture  generation  is  a  technique  for  increasing  scene  detail 
without  resorting  to  ever  increasing  edge,  polygon,  or  curved  surface 
generation  capacity;  that  Is,  a  texture  pattern  can  be  mapped  on  a 
surface  at  a  computational  cost  far  lower  than  that  expected  by 
conventional  modeling  methods,  Blln  (1978)  and  Skolmoskl  and  Fortin 
(1982)  describe  techniques  for  generating  texture  In  an  edge-based 
system.  Gardner  and  his  associates  (see  Gardner  &  Gershowltz,  1962) 
describe  techniques  for  generating  texture  in  a  curved-surface-based 
system.  These  techniques  provide  a  highly  efficient  way  to  map  texture 
onto  the  ground  plane  (flat  or  curved)  and  the  surfaces  of  any  fixed  or 
moving  object.  In  addition,  the  technique  allows  an  efficient  means  of 
modeling  Irregular  features  with  dynamic  capability,  such  as  trees  and 
grass  blown  by  rotor  wash,  moving  clouds,  and  billowing  dust  or  smoke. 

Computer-Synthesized  Imagery 

A  recently  developed  technique  for  high  fidelity  scene  generation 
is  referred  to  as  the  Computer  Animated  Photographic  Terrain  View 
(CAPTV)  concept  (Hooks  4  Devarajan,  1981).  The  data  base  for  this 
technique  Is  generated  by  a  series  of  overlapping  photographs  taken  with 
an  aerial  camera  that  provides  for  360*  of  azimuth  coverage  and  100°  of 
elevation.  The  camera,  attached  to  the  underside  of  an  aircraft,  has 
seven  lenses  and  associated  mirrors  that  cast  the  Image  onto  nine-inch 
color  film.  Six  lenses  capture  the  oblique  views  and  the  central  lens 
covers  the  straight  down  vertical  view.  Photographs  are  taken  at 
regular  Intervals  along  straight  and/or  cross  tracks, 

A  flying  spot  scanner  la  used  to  scan  the  nine-inch  film  to 
provide  a  pixel  resolution  of  about  4,000  pixels  In  both  horizontal  sad 
vertical  directions.  The  resulting  data  base  is  stored  on  video  discs 
along  with  tho  eye  point  of  every  scene.  As  the  simulated  aircraft 
fJies  through  the  gaming  area,  the  appropriate  photographs  are  retrieved 
from  the  storage  device  for  display.  Tlia  photographs  nearest  the 
eyepoinf  of  tlv;  operator  of  the  simulated  aircraft  are  "...stretched, 
skewed,  rotated,  and  translated  In  a  piece-wise  continucus  mathematical 
transformation  such  that  the  transformed  photo  would  overlay  a  different 
photo  taken  from  the  operatc.-’s  eyepoint"  (Hooka  4  Devarajan,  1981..  p. 
47).  In  short,  the  CAPTV  device  is  capable  of  syntheslting  a  high- 
fidelity  image  of  the  ground  ar  neen  from  a  point-of-regard  different 
from  the  point  from  which  any  photograph  was  tak* a. 

A  similar  approach  to  computer-synthesized  imagery  is  described  by 
Stlckel  (1982).  He  describes  a  method  for  synthesizing  imagery  from 
four  types  of  components:  terrain  image,  target  image,  sight  reticle 
pattern,  and  weapon  delivery  effect.  Graf  and  Baldwin  (1982)  describe  a 
hybrid  technique  in  whicli  high  ro.solution  photographs  arc  merged  with  a 
computer-gencratec  Image.  This  tcclinlque  is  referred  to  as  Computer- 
Gene  rated/Syntliesized  Imagery  (CGSI).  A  acene  is  constructed  by  placing 


Individual  high-fidelity  computer  synthesized  objects  on  a  specified 
computer-generated  surface. 


Improvements  to  Existing  CIG  Systems 

There  are  a  number  of  efforts  underway  that  promise  to  increase 
the  realism  of  CIG  scene  elements  and  to  Increase  the  range  of 
tasks/condicions  that  CIGa  can  be  used  to  train.  Among  the  most 
important  of  these  are: 

•  improved  capability  to  simulate  sensor  Imagery  (Hooks  & 
Devarajan,  1981;  Faintlsh  &  Gough,  1981;  Pierce,  1982), 

•  improved  capability  to  simulate  atmospheric  phenomena  (Allsopp, 
1978;  Gardner  &  Gerahowltz,  1982;  Johnson,  1978;  Stenger, 
Zlraraerlin,  Thomas,  A  Braunstein,  1981), 

•  Improved  anti-aliasing  techniques  (Bunker,  1982;  Gardner  A 
Berlin,  1980;  Gardner  A  Gershowitz,  1982), 

a  improved  special  effects  (Booker,  Collery,  Csuri,  A  Zeltzer, 
1982;  Gardner  A  Gershowitz,  1982), 

•  improved  level-of-detall  (LOD)  management  (AGARD,  1981; ’Mayer  A 
Cosman,  1982;  Stenger  et  al. ,  1981),  and 

e  improved  CIG  data  base  and  data-base  construction  techniques 
(Hughett,  1980;  Bock  A  Hlcol,  1980;  Cunningham  A  Picasso,  1980; 
Pierce,  1982). 

Developments  in  all  of  the  above  technological  areas,  and  perhaps 
others  as  well,  may  have  a  major  influence  on  the  development  and 
evaluation  of  candidate  scene  elements. 


Compile  Inventory  of  Candidate  Scene  Elements^ 

It  was  Judged  that  thu  most  sensible  way  to  commence  formulating 
hypoth(2acs  .'tbout  \/hac  features  ought  to  appear  on  a  CIC  display  is  to 
examine  tlie  real-world  features  chat  helicopter  aviators  refer  to  when 
performing  the  various  flying  tasks  of  interest  under  the  various 
conditions  of  interest.  Accordingly,  Che  purpose  of  the  task  discussed 
her'  is  to  compile  an  Inventory  of  the  natural  and  cultural  features 
chat  helicopter  pilots  are  known  to  refer  to  and  to  select  from  this 
inventory  a  set  of  feacres  that  can  be  considered  as  candidate 
"elements"  for  use  in  constructing  one  or  more  CIG  display  scenes. 


^Unless  stated  otharwlra;,  the  term  "scene"  refers  to  all  computer- 
generated  imagery  that  may  become  visible  during  the  performance  of  a 
given  flying  task.  So,  not  all  cloments  of  a  scene  will  appear  on  the 
display  at  any  given  time.  The  term  "scene  element"  is  u.sed  here  In  a 
Very  general  sense;  the  term  encompas.sns  dl.screte  objects,  terrain 
relief,  texCuru  elements,  sur facu-toxt\ire  elements,  and  shadows. 


One  of  the  main  objectives  of  the  second  research  task  described 
above— Identify  Information  Requlrements/Sourccs— Is  to  Identify  the 
extra-cockpit  features  that  aviators  look  at  In  their  attempts  to  obtain 
the  visual  Information  they  need  to  perform  a  given  flying  task.,  The 
data  yielded  by  this  task  will  be  used  to  construct  a  "task-by-feature" 
matrix  In  which  (a)  taaks/condltlona  are  listed  along  one  axis  of  the 
matrix,  (b)  features  are  listed  along  the  other  axis  of  the  matrix,  and 
(c)  cells  within  the  matrix  are  checked  to  Indicate  the  features  chat 
aviators  sometimes  or  always  refer  to  when  performing  the  corresponding 
cask. 

The  initial  listing  will  surely  contain  several  hundred  different 
feacures--far  more  than  could  be  or  should  be  modeled  and  used  as  CIG 
scene  elements.  As  a  consequence,  It  will  be  necessary  to  reduce  the 
list  to  more  closely  approximate  the  .smallest  number  of  features  that 
are  necessary  and  sufficient  to  perform  Che  full  range  of  flying  tasks. 
This  will  be  done  by  Identifying  features  that  are  serving  precisely  the 
same  function  and  eliminating  from  further  consideration  all  but  two  or 
three  features  within  such  a  set.  The  data  from  the  information 
requirements  analyses,  described  earlier,  will  be  u.sed  to  pare  down  the 
feature  list  to  a  manageable  number. 

For  purposes  of  illustration,  consider  the  cask  of  flying  traffic 
patterns.  When  learning  to  fly  VFR  traffic  patterns  at  any  airfield, 
helicopter  aviators  select  a  feature  on  the  ground  to  use  as  a  referent 
in  deciding  when  to  Initiate  the  turn  for  each  leg  of  the  traffic 
pattern.  Almost  any  small  natural  or  cultural  feature  that  is  visible 
and  Identifiable  serves  this  purpose  equally  well.  So,  In  developing  a 
display  format  suitable  for  training  on  flying  traffic  patterns,  it  is 
unnecessary  to  model  (for  CIG  display)  buildings,  fence  rows,  ponds, 
isolated  trees,  road  intersections,  and  Che  scores  of  other  features 
that  aviators  sometimes  use  as  referents  in  deciding  when  to  Initiate 
traffic-pattern  turns.  Models  of  two  or  three  unique,  highly  visible 
features  stunild  be  adequate  for  this  purpose. 

Ther'!  ari'  Home  Instances  in  which  the  nature  or  difficulty  of  a 
task  is  f  nf  1  ucnccil  by  tlu’  type  of  feature  used  as  a  visua.l  refurent  in 
performing  the  task.  The  task  of  masking  and  unma.sking  is  an  ex.ample; 
the  difficulty  of  the  t.3sk  varies  greatly  as  a  function  of  the  type  of 
fo.iture  being  used  as  a  masking  object.  Aviators  report  that 
masking/unmnsking  behind  a  gently  sloping  ridge  or  hill  is  far  more 
difficult  tlian  masking/unracasklng  behind  a  row  of  tall  trees  or  behind  a 
building.  The  difference  in  difficulty  is  the  result  of  the  proximity 
of  features  that  provide  infonoatlon  about  the  aircraft’s  deviation  from 
the  desired  hover  position  when  unmasked.  Obviously,  features  used  as  a 
visual  referent  for  the  same  task  cannot  be  eliminated  if  they  influence 
the  nature  or  difficulty  of  the  task  in  a  manner  such  as  chat  described 
above . 

Tlierc  if.  considerable  uncertainty  about  how  to  deal  with  features 
Chat  serve  as  navigational  checkpoints.  One  of  the  factors  contributing 


to  the  difficulty  of  navigation  is  that  a  given  map  symbol  is  used  to 
symbolize  real-world  features  whose  appearance  varies  widely.  This  is 
true  for  both  natural  and  cultural  features.  The  use  of  only  one  or  two 
different  CIG  models  for  any  class  of  feature,  such  as  streams,  would 
result  in  an  unrealistic  simplification  of  the  navigation  task.  And 
yet,  attempting  to  model  a  set  of  features  that  approachefs  the  range  of 
different  appearances  found  in  the  real  world  would  be  ^ prohibitively 
costly  unless  greatly  Iroprovud  modeling  techniques  are  developed. 

The  compilation  of  an  inventory  of  candidate  scene  elements  should 
be  performed  by  a  team  composed  of  (a)  the  experienced '  aviators  who 
supported  the  information  requirements  analysis,  and  (b)  behavioral 
scientists  who  are  thoroughly  familiar  with  helicopter  operations  and 
with  the  literature  on  human  visual  perceptions. 


Develop  Candidate  Scene-Element  Designs 

The  purpose  of  this  task  is  to  develop  candidate  scene-element 
designs  for  subsequent  empirical  evaluation.  As  was  stated  before,  the 
capabilities  and  constraints  that  dictate  scene-element  designs  will 
depend  on  the  technological  advancements  that  are  made  prior  to  the  time 
this  task  is  begun.  If  future  CIG  systems  remain  nearly  os  edge  limited 
as  contemporary  CXG  systems,  the  goal  must  be  to  produce  scene-element 
designs  that  can  be  modeled  with  as  few  edges  as  is  possible  and  still 
provide  adequate  visual  information  for  effective  training.  Apparent 
realism  will  be  a  secondary  consideration.  On  the  other  hand,  if 
technological  innovations  result  in  orders  of  magnitude  Increases  In 
real-time  image  generation  capacity  and  modeling  efficiency,  scene- 
element  realism  can  be  made  a  more  Important  criterion  for  evaluating 
scene-element  design.®  However,  it  is  unlikely  that  CIG  capacity  will 
ever  Increase  to  the  point  that  there  will  be  no  requirement  for 
attempting  to  conserve  basic  modeling  units— edges,  polygons,  quadratic 
surfaces,  or  bicubic  patches — in  developing  scene-element  designs. 

Since  thu  literature  contains  insufficient  data  to  enable  one  to 
predict  the  reiatlonphtp  hetwoun  level  of  realism  and  aviator  Judgment 
accuracy,  it  will  be  necessary  to  develop  and  assess  scene-element 
designs  that  vary  in  their  level  of  realism.  One  approach  to  designing 
scene  elements  that  vary  In  realism  is  to  give  several  designers — 
working  individually  or  as  a  team — different  allotments  of  modeling 
units  (edges,  curved  surfaces,  etc.)  and  instruct  them  to  design  a 
specific  element,  say  a  tree,  with  the  greatest  realism  possible  without 
exceeding  the  allotment  of  modeling  units.  Although  this  is  considered 
a  workable  approach,  it  must  be  acknowledged  that  the  approach  does  not 

®Trainlng  effectiveness  Is  the  ultlniratc  criterion  for  evaluating  design. 
Edge  requirements  and  apparent  realism  are  criteria  propo.scd  to  select 
prototype  models  th.it  subsequently  will  be  G\fa]uated  in  terms  of 
training  effectiveness. 


ensure  that  realism  will  vary  as  a  direct  function  of  the  modeling-unit 
allotment.  Indeed,  it  Is  to  be  expected  that  the  Innovative  use  of 
modeling  units  could  more  than  offset  the  differences  In  the  allotment 
of  modeling  units.  It  Is  also  to  be  expected  that,  beyond  a  given 
point.  Increased  realism  of  an  object  simply  cannot  be  achieved  by  using 
a  greater  number  of  modeling  units. 

In  addition  to  differences  in  the  allotment  of  basic  modeling 
units,  the  model  designers  should  be  given  different  combinations  of 
other  capabilities,  such  as: 

•  texturing  functions--function3  that  enable  the  modeler  to  assign 
texture  to  surfaces  and  to  vary  the  statistical  properties  of 
the  texture, 

•  surface  reflection  functions--functions  that  enable  the  modeler 
CO  assign  diffuse  and  specular  reflectance  properties  to  a 
surface, 

•  color  functions — functio:  '  that  enable  the  modeler  to  assign 
color  to  aurfaces/objects  or  portions  of  surfaces/objects,  and 

•  translucency  functions— functions  that  enable  the  modeler  to 
vary  the  translucency  of  3-D  object  boundaries,  2-D  object/area 
boundaries,  and  boundaries  at  which  level-of-detail  changes, 

The  capabilities  and  constraints  imposed  on  the  model  builder 
should  be  formulated  through  the  study  of  the  capabilities  and 
constraints  of  operational  and  prototype  CIG  systems.  Consideration 
should  be  given  Co  CIG  systems  in  the  conceptual  design  stage  only  if 
methods  ave  available  Co  generate  dynamic  images  of  the  element  designs 
that  the  new  CIG  will  be  capable  o.f  producing,  tn  short,  there  is  no 
reason  to  develop  element  designs  that  cannot  be  evaluated  under  dynamic 
conditions , 

There  is  no  one  discipline  that  uniquely  qualifies  an  individual 
to  develop  scene  designs.  Psychologists  knowledgeable  about  human 
visual  pGrceptlon  and  computer  scientists  knowledgenble  about  CIG 
functioning  certainly  should  he  represented  on  the  design  team.  In 
addition,  it  seeta,'-'  likely  dial  artists  and  animators  could  bring 
valuable  knowledge  and  skills  to  a  de.slgn  team  that  most  p.sychologists 
and  computer  .scientists  do  not  possess. 

The  following  subsection  discusses  factors  Chat  must  be  considered 
in  modeling  CIC  features  that  must  be  referenced  to  a  map,  such  as 
features  that  are  used  as  checkpoints  for  NOE  navigation.  The  remaining 
subsections  discuss  various  issues  associated  with  modeling  terrain 
relief,  surface  texture,  two-  and  three-dimensional  objects,  and  special 


Modeling  Generic  and  Kap-Referenced  Features 

There  are  some  flying  Casks  rhat  cannot  be  performed  without 
referring  to  a  map.®  Nap-of-the-earth  navigation,  directing  artillery 
fire,  and  aerial  reconnaissance  are  examples  of  tasks  for  which  map 
referencing  Is  essential.  Topographic  maps  also  are  essential  to  the 
planning  and  coordination  of  virtually  all  combat  operations.  If  a  GIG 
.system  is  to  be  used  to  train  tasks  that  require  aviators  to  associate 
map  features  with  their  real-world  counterpart,  the  features  In  the  GIG 
gaming  area  must  be  modeled  in  a  manner  that  enables  such  associations 
to  take  place.  Specifically,  the  features  In  the  GIG  gaming  area  must 
he  modeled  such  that  the  relationship  between  GIG  features  and  the  map 
is  the  same  as  the  relationship  between  real-world  features  and  the  map. 

The  map  of  an  area  is  not  designed  to  be  a  faithful  facsimile  of 
the  real-world  features  that  appear  in  that  area.  Limitations  and 
constraints  imposed  by  map  scale  make  it  impossible  to  produce  a 
faithful  facsimile  at  a  1:50,000  scale.  Just  as  the  map  is  not  a 
faithful  facsimile  of  the  real  world,  the  GIG  gaming  area  cannot  be  made 
to  be  a  faithful  facsimile  of  the  map.  To  do  so  would  simplify 
oao-referencing  tasks  to  such  an  extent  that  practice  with  the  GIG 
system  would  be  of  no  value,  Indeed,  reinforcing  the  fallacious 
expectations  of  a  one-to-one  correspondence  between  map  features  and 
reni-world  features  would  almost  surely  lead  to  negative  transfer-of- 
cralning. 

As  a  consequence,  when  modeling  what  is  referred  to  here  as 
"map-referenced"  features,  a  modeler  must  be  thoroughly  knowledgeable 
about  the  rules  and  conventions  that  cartographers  follow  in  compiling 
1 : 50 , 000-scale  topographic  maps.  For  example,  modelers  must  know  that: 

•  only  a  fraction  of  the  topographic  features  in  the  real  world 
are  selected  for  portrayal  on  the  map, 

•  the  rules  and  conventions  used  in  selecting  features  for  map 
portrayal  vary  from  one  geographical  area  to  another, 

•  the  features  that  are  selected  for  portrayal  are  represented  or. 
the  map  with  point  or  linear  symbols  that  may  be  genera llred  in 
sh.ape,  exaggerated  in  scale,  or  displaced  in  position  in 
accordance  with  formal  rules  and  informal,  conventions  that 
govern  m.ap  compilation. 


^Helicopter  training  operations  within  the  U.S.  are  almost  always 
performed  with  a  1  : 50 ,000-scale  topographic  map  produced  by  Defense 
Mapping  Agency  (DMA)  cartographers.  Combat  and  training  operations 
outside  the  U.S.  may  be  performed  with  topographic  maps  compiled  by 
foreign  cartographers.  The  design  similarity  of  foreign  maps  to  maps 
compiled  by  DMA  per.sonnel  varies  greatly  from  one  country  to  another. 
The  differences  of  primary  concern  are  differenco.s  in  Che  selection  and 
classif  ici-itl'ni  of  fe.ntures  for  map  porcr.ayal  . 


•  a  cluster  of,  say,  three  standard  building  symbols  (solid  black 
square)  may  be  used  to  depict  a  cluster  of,  say,  seven 
real-world  structures  that  arc  spaced  so  closely  that  they 
cannot  be  portrayed  individually  without  overlapping  the 
symbols, 

•  email  bends  In  roads  and  stream  beds  cannot  be  portrayed  because 
of  limitations  imposed  by  scale,  and 

•  the  same  solid  blue  line  is  used  to  portray  all  perennial 
streams  with  a  bank-to-bank  width  less  chan  25  meters. 

The  above  represent  just  a  fraction  of  the  systematic  differences 
between  mapped  features  and  their  real-world  counterpart.  In  order  to 
model  a  PIG  gaming  area  chat  will  prove  effective  Jn  training  map- 
referencing  tasks,  Che  modeler  must  pr'.Jjce  the  same  systematic 
differences  between  the  map  and  GIG  features. 


Terrain  Relief  Modeling 

Many  of  Che  tasks  listed  In  Appendix  A  can  be  trained  effectively 
with  no  elevated  landforma  whatsoever.  For  example,  a  flat  textured 
ground  plane  should  be  adequate  for  training  such  basic  tasks  as  takeoff 
to  a  hover,  hovering  turns,  climbs  and  descents,  traffic  pattern  flight, 
approaches,  landings,  and  perhaps  others  as  well.  For  Casks  such  as 
these,  the  only  utility  of  terrain  relief  would  be  to  "decorate"  the 
scene  or  to  eliminate  an  unrealistically  clear  horizon  line. 

Other  tasks  require  terrain  relief  but  can  be  trained  effectively 
with  "generic"  terrain  relief;  chat  is,  displayed  terrain  relief  does 
not  have  to  be  associated  with  terrain  relief  portrayed  on  a  map. 
Examples  of  tasks  that  clearly  could  be  trained  with  generic  terrain 
relief  are  pinnacle  operations,  rldgellne  operations,  slope  operations, 
and  NOE  decelerations.  Most  GIG  system  vendors  have  assumed  that 
effective  traininj’  on  contour  and  NOK  flight  cun  be  accomplished  with 
generic  terrain  relief.  This  assumption  is  probably  valid  for  aviators 
of  hlgh-speoil  fixed-wing  aircraft  but  Is  questionable  for  helicopter 
aviators.  A.s  was  stated  earlier,  helicopter  aviators  have  acquired  a 
high  level  of  perceptual  and  aircraft-handling  skills  prior  to  the  time 
they  commence  training  on  contour  flight  and  NOE  flight.  The  extent  to 
which  aviators'  perceptual  and  aircraft-handling  skills  would  be  further 
enhanced  by  practicing  contour  and  NOE  flight  with  generic  terrain 
relief  is  not  known.  Anecdotal  evidence  from  discussions  with 
experienced  aviators  indicates  that  the  most  critical  deficiency  at  this 
stage  of  training  is  in  the  cognitive  skills  required  to  navigate 
accurately  during  contour  and  NOF.  flight. 

There  arc  a  substantial  number  of  tasks  that  clearly  cannot  be 
trained  using  generic  terrain  relief.  Training  on  NOE  navigation  is  a 
critically  Important  skill  th.at  requires  the  modeling  of  map-referenced 
terrain  relief.  Other  ta.sks  requiring  map-referenced  terrain  relief 


Include  target  handoff,  the  direction  of  artillery  fire,  aerial 
reconnaissance,  and  combat  engagements  by  a  multiple  aircraft  team.  The 
decision  to  train  such  tasks  using  a  CIU  system  imposes  severe  require¬ 
ments  for  modeling  terrain  relief.  First  it  will  be  necessary  to  use 
the  DMA  Digital  Landmass  System  (DLS)  data  base  or  another  data  base  to 
model  terrain  relief.  The  DMA  data  base  is  the  only  source  of  data  on 
terrain  relief  for  which  topographic  maps  are  available. 

Second,  the  terrain  relief  must  be  modeled  such  that  relatively 
small  attributes  of  landfoms  can  be  perceived  in  the  CIG  image.  To 
maintain  accurate  geographic  orientation  at  low  altitudes,  the  heli¬ 
copter  crewmen  must  be  able  to  associate  small  terrain  features  to  their 
counterpart  on  the  map.  Small  draws,  small  spurs,  sm-ill  saddles,  the 
steepness  and  shape  of  slopes,  and  small  stream  beds  aie  examples  of 
features  chat  aviators  must  be  capable  of  associating  with  the  map  in 
order  to  navigate,  accurately  at  NOE  altitudes.  Clearly,  it  is  not 
enough  to  display  large  landforms,  such  as  wide  valleys  and  large 
ridgelines,  in  Che  CIG  scene. 

Finally,  it  will  be  necessary  to  model  several,  different  types  of 
terrain  relief.  Trair.l.tg  in  one  type  of  terrain  does  not  fully  prepare 
an  aviator  to  perform  map-referenced  tasks  In  a  different  type  of 
terrain.  For  Instance,  navigation  training  in  an  area  with  low  rolling 
hills  does  not  fully  prepare  an  aviator  to  navlgats  in  mountainous 
terrain. 


Texture  Modeling 

In  Che  past,  texturing  of  surfaces  In  a  CIG  scene  has  been 
accomplished  by  modeling  two-dimensional  objects  (a  uniform  grid. 
Irregularly  shaped  polygons,  etc.)  end  mapping  them  onto  the  surface  of 
the  ground  plane  or  the  surface  of  three-dimensional  objects  appearing 
in  the  scene.  Texturing  of  Che  ground  plane  also  has  been  accomplished 
by  modeling  three-dimensional  objects,  such  as  trees  or  structures,  and 
mapping  them  onto  the  surface  of  the  ground  plane.  These  techniques  are 
costly  in  terras  of  both  modeling  time  and  CIG  computational  capacity, 
Kor  example,  Slnacorl  has  calculated  that  about  L7  million  discrete 
texture  elements  (Sinacori  used  trees  os  texture  element.^  in  his 
computations)  would  be  contained  within  a  circle  one  mile  in  radius  if 
Clio  texture  elements  were  separated  by  an  average  of  15  feet. 

The  next  generation  of  CIG  systems  almost  certainly  will  provide 
modelers  with  far  more  efficient  techniques  for  mapping  texture  onto  the 
surface  of  the  ground  plane  and  the  surfaces  of  both  stationary  or 
moving  objects.  The  most  advanced  texturing  techniques  developed  to 
date  employ  mathematical  functions  to  modulate  the  shading  intensity  of 
a  surface.  For  detailed  discussions  of  these  techniques,  see  Gardner 
and  Gershowitz  (19f!2)  and  Skolmoski  and  Fortin  (  1982),  Such  teclinlquos 
will  enable  CIG  scene  modelers  to  generate  a  wide  variety  of  textures 
varying  from  the  regular  texture  pattern  of  a  brick  wall  to  the  highly 
irregular  texture  pattern  formed  by  the  leaves  of  a  tree. 


It  seems  probjible  chat  mapping  texture  onto  CIG  surfaces  will 
serve  Co  increase  the  veridicality  of  judgments  of  surface  slant/ 
curvature,  distance,  and  relative  velocity.  However,  the  current 
perception  literature  lacks  the  In'^ormatlon  that  Is  needed  to  specify 
the  characteristics  of  an  effective  cescturlng  function  or  to  estimate 
Che  benefits  that  would  result  from  texturing  surfaces  Chat  appear  in  a 
dynamic  CIG  scene.  Baaed  upon  a  comprehensive  review  of  the  perception 
literature,  Stenger  and  his  associates  summarize  the  germane  literature 
as  follows: 

Research  on  static  texture  has  generally  found  that  while 
regular  textures  are  effective  in  conveying  surface  slant 
to  observers,  irregular  textures  are  definitely  less 
affective  and  sometimes  completely  ineffective  (Degelman  4 
Rosinski,  1976;  Gibson,  1950;  Gibson  4  Gibson,  1957;  Levine 
&  Rosinski,  1976;  Newman,  1972;  Newman,  Uhinham,  &  MacRae, 

1973;  Rosinski  4  Levine,  1976).  Although  research  with 
random  textures  in  dynamic  scones  has  shown  good  correspond 
dence  (usually  with  some  underestimation)  between  displayed 
and  judged  slants  (Gibson,  Gibson,  Smith,  &  Flock,  1959), 
this  accuracy  appears  to  be  based  on  the  velocity  gradient 
Information  carried  by  the  texture  rather  than  on  the 
texture  gradient  per  se  (Braunstein,  1968) ,  Farber  and 
McConkie  (1979)  suggest  that  the  velocity  gradient  may 
reveal  degree  of  slant  range  while  the  texture  gradient 
reveals  direction,  but  this  hypothesis  remains  to  be 
tested.  This  issue  is  part  of  an  unanswered  question  that 
is  Important  to  the  design  of  CIG  displays:  Is  texture 

effective  primarily  (or  exclusively)  as  a  carrier  of 

velocity  information,  or  does  the  texture  gradient  itself 
provide  information  that  reduces  the  ambiguity  of  surface 
definition?  (Stenger  et  al.,  1981,  p.  75) 

An  extensive  psychophysical  research  program  is  needed  to 
determine  how  best  to  use  two-dimensional  texturing  on  CIG  surfaces. 

Ahso,  research  is  needed  to  determine  the  effects  of  three-dimensional 
texture  —  singly  and  in  comhlnatlon  with  two-d  1  iiions  ^  ona  1  te.xture — on 
judgments  of  surface  slant/curvatnre ,  distance,  and  relative  velocity. 
A  detailed  discussion  of  the  requirements  for  research  on  surface 

texturing  is  presented  in  the  following  section. 


Object  Modeling 

The  term  "object"  is  used  here  to  refer  to  any  two-dliren.sionul  or 
three-dimensional  form  other  than  terrain  relief,  surface-texture 
elements,  and  shadow.^.*®  The  modeling  of  candidate  objects  must 

^®As  was  stated  in  footnote  7,  the  term  "scene  elements"  encompasses 
"objects"  as  well  as  terrain  relief,  surf. ace-texture  elements,  and 
shadows . 


commence  with  a  study  of  the  function  served  by  each  Item  listed  on  the 
object  inventory  compiled  during  the  information  requirements  analysis. 
The  function  served  by  an  object  may  be  any  one.  or  more  of  the 
following; 

•  scene  decoration — an  object  that  contributes  to  scene  realism 
but  has  no  direct  impact  on  perceptual  Judgments  made  as  a 
result  of  viewing  the  scene, 

•  position  referent— -a  stationary  object  that  an  aviator  uses  as  a 
referent  In  positioning  his  aircraft  In  the  x,  y,  and  z  axes 
(airfield,  confined  area,  traffic  pattern  referents), 

•  perceptual  calibration  referent — an  object  of  known  size  that 
aviators  use  to  establish  the  scale  of  a  CIG  scene, 

•  perceptual  learning  referent— an  object  that  must  be  present  in 
the  scene  in  order  for  requisite  perceptual  learning  to  take 
place , 

a  generic  target  for  weapons  training— a  stationary  or  moving 
object,  not  referenced  on  a  map,  that  serves  as  a  target  for 
weapons  training, 

e  nap-ref erenned  target  for  weapons  training— a  stationary  object 
chat  serves  as  a  target  for  weapons  training  and  that  must  be 
referenced  to  a  standard  topographic  map, 

•  generic  target  for  target  detection/identification  training— a 
non-map-referenced  object,  stationary  or  moving,  that  is  used  in 
training  aviators  to  detect  and/or  identify  targets, 

e  nap-referenced  target  for  target  detection/ldentif ication 
training— a  map-refenced,  stvatlonary  object  that  is  used  to 
train  aviators  to  detect  and/or  identify  tirgats,  and 

•  navigation  checkpoint — an  object,  which  may  or  may  not  be 
portrayed  on  the  map,  that  serves  as  a  potential  navigation 

checkpoint , 

The  |•unc.;lons  served  by  an  object  have  a  major  impact  on  the 
manner  in  wlilcl.  the  object  must  be  modeled.  For  example,  con.sldor  tho 
modeling  of  a  r.ian-made  structure.  A  structure  that  serves  only  as  scene 
decoration  or  as  a  po.sition  referent  can  be  nearly  any  size  and  shape. 
If  it  serves  is  a  position  referent.  It  need  only  be  unique  enough  to 
enable  avlatovs  to  distinguish  it  from  other  structures  in  the  CIG  data 
base.  If  the  structure  serves  as  a  perceptual  calibration  referent,  the 
aviator  must  be  able  to  associate  it  with  a  real-world  structure  whose 
size  is  known;  or,  the  aviator  must  be  Instructed  on  the  exact 
dimension.^  of  the  structure.  A  structure  that  serves  as  a  perceptual 
learning  referent  must  be  modeled  such  that  the  perceptual  learning 
resulting  from  practicing  with  the  CIG  structure  will  generalize  to 
similar  real-world  structures.  F.-stabllshing  what  features  a  CIG  object 
must  have  i.o  ensure  perceptual  learning,  of  course,  is  one  of  the  mo.st 
critical  and  lllu.slve  tasks  in  this  program  of  research. 


Nearly  any  type  of  structure  can  serve  as  a  generic  target  for 
weapons  training.  However,  If  the  structure  Is  one  that  must  be  related 
to  its  map  portrayal,  the  shape  and  size  of  the  object  will  be  dictated, 
to  some  degree,  by  the  symbol  used  to  depict  the  object  on  the  map.  For 
instance,  If  the  structure  is  portrayed  with  a  standard  building  symbol, 
it  roust  be  a  permanent  dwelling  or  a  commercial  building  whose  largest 
dimension  does  not  exceed  about  25  meters.  If  the  structure  is  por¬ 
trayed  to  scale  on  the  roap,  the  corresponding  structure  nodelsd  for  CIG 
display  must  have  the  same  dimensions  and  outline-shape  as  the  symbol. 
A  structure  that  serves  as  a  navigation  checkpoint  must  be  modeled  in 
the  same  manner  as  a  structure  that  serves  as  a  map-referenced  target. 

Probably  the  most  stringent  modeling  requirements  are  those  of 
objects  that  serve  as  a  target  for  target  detection  and/or  identifi¬ 
cation  training.  For  target  detection  training,  the  modeler  must  design 
the  object  and  Che  background  against  which  it  is  viewed  in  a  manner 
that  presents  the  aviator  with  a  realistically  difficult  discrimination 
task.  This  will  require  careful  modeling  of  the  brightness  contrast, 
color  contrast,  reflectance,  and  image  complexity  of  both  the  object  and 
its  background.  An  object  that  serves  as  a  target  for  target  identifi¬ 
cation  training  must  be  modeled  In  sufficient  detail  to  (a)  enable  the 
aviator  to  differentiate  the  object  from  other  CIG  objects  of  the  same 
class,  and  (b)  ensure  that  the  target  identification  training  will 
generalize  to  real-world  situations. 

The  required  specifications  for  an  object  model  Include:  the 
equations  Chat  determine  the  geometric  shape  of  the  surfaces,  parameters 
that  determine  the  reflective  properties  of  each  surface  (total  reflec¬ 
tance  and  fraction  of  diffuse  and  specular  reflectance),  parameters  that 
dictate  the  color  (hue  and  saturation)  of  each  surface,  and  modulation 
functions  that  determine  the  texturing  of  each  of  the  object's  surfaces. 

Such  specifications  must  be  developed  for  both  direct  view  end  one 
or  more  sensor  views  of  the  object.  Low-light-level  TV  is  so  similar  to 
the  direct  view  that  additional  parameters  need  not  be  added  to  the  data 
base;  the  elimination  of  color  and  the  reduction  of  resolution  should  be 
the  only  requirements  for  modifying  tlie  basic  direct-view  model  of  an 
object.  However,  the  Forward-Looking  Infrared  (FI, IK)  Imnge  of  nn  object 
can  be  and  usually  is  markedly  different  from  the  direct-view  image  of 
the  same  object,  Gardner  and  Gershowitz  discuss  one  approach  to 
generating  FLIR  images  of  objects  "  (Gardner  &  Gershowitz,  1982,  pp. 
193-197).  They  identify  the  global  Infrared  (IR)  parameters  that  must 
be  specified  for  each  object  and  presents  equations  for  computing 
intensity  for  (a)  IR  day  Images  of  passively  emitting  objects,  (b)  IR 
day  Images  of  actively  emitting  surfaces,  (c)  IR  night  Images  of 
passively  emitting  objects,  and  (d)  IR  night  images  of  actively  emitting 
surfaces . 

An  altogether  different,  approach  to  producing  KLIR  Imagery  has 
been  developed  by  Hooks  and  DevaraJ.in  (1981).  Thin  approach  employs 
monochrome  infrared  aerial  photographs  stored  in  a  largo  random-access 
video  data  base.  The  data  in  the  video  data  baso  arc  procosnod  by  a 


computer  to  generate  the  imagery  from  any  point  of  regard.  If  this 
approach  Is  employed,  there  would  be  no  need  to  model  FLIR  imagery  from 
a  numerical  data  base  such  as  the  DMA  Digital  Data  I3ase. 


Special  Effects  Modeling 

Consideration  must  be  given  to  the  modeling  of  at  least  four 
classes  of  special  effects;  shadows,  atmospheric  phenomena,  weapons 
effects,  and  lights.  The  following  paragraphs  comment  briefly  on  the 
relevance  of  each  of  these  classes  of  special  effects  for  a  CIG  designed 
solely  for  training  helicopter  aviators. 

For  centuries,  artists  have  recognized  the  role  of  shadows  in 
producing  the  illusion  of  depth  on  a  two-dimensional  surface.  Yet,  not 
a  single  study  has  been  located  in  the  literature  that  has  been  designed 
to  assess  the  Impact  of  shadows  on  the  verldicallty  of  perception  of  a 
computer-generated  Image.  Even  the  classical  perceptual  literature  on 
the  role  of  shadows  is  extremely  limited.  The  few  studies  in  which 
shadows  were  Investigated  as  an  independent  variable  used  simple 
photographs  or  drawings  as  stimuli  (Cross  &  Cross,  1969;  Hess,  1961; 
Yonas,  Goldsmith,  4  Hallstrom,  1978).  Although  these  studies  confirmed 
that  shadows  have  a  major  Impact  on  perception,  they  provide  Insuffi¬ 
cient  Information  to  draw  any  Inferences  about  the  importance  of  shadows 
In  a  dynamic  CIG  scene. 

In  the  real  world,  shadows  may  provide  or  obscure  significant 
cues.  The  detection  and  Identification  of  objects  may  become  far  more 
difficult  when  they  appear  in  the  shadow  of  another  object— especially 
at  low  sun  angles  and  during  periods  of  darkness  when  moonlight  lsn!t 
Intense  enough  to  create  shadows.  On  the  other  hand,  shadows  may  aid 
Che  detection  of  moving  targets  and  may  facilitate  the  perception  of  the 
shape  of  complex  landfonns.  There  Is  anecdotal  evidence  that  shadows  in 
a  CIG  scene  are  sometimes  required  to  avoid  perceiving  three-dimensional 
objects  as  "floating"  above  the  ground  plane  on  which  they  are  located. 

The  method  used  to  gunernte  sliad(.'vs  Is  certain  to  liave  a  major 
impact  on  CIG  costs.  Storing  of  objects  ar-  shadows  would  nearly  double 
the  size  of  the  CIG  system  data  base,  since,  every  three-dimensional 
object  casts  a  shadow.  Conversely,  generating  shadows  on-line  would 
nearly  double  the  computation.il  load  of  the  CIG  system.  If  these  two 
techniques  were  the  only  ones  available,  it  is  doubtful  that  the 
benefits  realized  from  shadow  generation  would  offset  the  cost.  So, 
there  is  a  critical  need  to  develop  more  efficient  techniques  for 
modeling  and  generating  shadows.  Gardner  and  Gershowltz  discuss  the 
problem  of  shadow  generation  and  describes  several,  techniques  for 
representing  the  essence  of  shadows  with  the  least  possible  overhead  in 
data  storage  and  computational  load  (Gardner  4  Gershowitz,  1982,  pp. 
54-76);  Gardner  and  Gershowltz  con.sidur  at  least  two  of  these  techniques 
to  be  cost  effective.  The  development  of  highly  cost-effective  shndow- 
generntion  teclinique.g  could  be  ;i  difficult  and  time-consuming  job,  so 


the  military  should  continue  to  support  efforts  to  develop  efficient 
methods  for  generating  shadows  In  CIG  scenes. 


The  second  class  of  special  ef  fect8--atrao8pheric  phenomena~is 
important  for  two  reasons.  First,  atmospheric  phenomena  must  be  modeled 
in  order  to  create  aerial  perspective— an  often  cited  cue  to  distance 
whose  role  in  perception  has  yet  to  be  determined.  Secondly,  atmos¬ 
pheric  phenomena  must  be  generated  in  order  to  use  CIG  systems  to  train 
aviators  to  fly  during  periods  of  degraded  visibility.  Atmospheric 
phenomena  that  must  be  generated  to  cover  the  full  range  of  visibility 
conditions  in  which  helicopter  aviators  must  be  able  to  operate  include; 

•  haae, 

•  fog  (solid  and  broken), 

•  clouds  (cloud  layers  and  3-D  clouds) , 

•  dust, 

•  smoke , 

a  rain,  and 

e  snow, 

The  models  used  to  generate  atmospheric  phenomena  can  very 
considerably  in  their  complexity  and,  therefore,  their  coat  in 
computational  time  (see  Allsopp,  1978;  Gardner  &  Gershowltz,  1982; 
Stenger  et  al.,  1981).  However,  no  empirical  data  are  available  on  the 
relationship  between  training  effectiveness  and  the  complexity 
(fidelity)  of  these  models.  Thus,  there  is  a  need  to  develop  models 
that  vary  systematically  in  their  fidelity  and  to  assess  the 
relationship  between  model  fidelity  and  training  effectiveness. 

Weapons  effects  are  a  third  type  of  special  effects  that  must 
receive  attention.  The  most  important  function  served  by  weapons 
effects  is  to  provide  feedback  Co  crew  members  about  the  accuracy  and 
the  result  of  their  weapons  firings.  Feedback  on  Che  destructive  force 
of  the  weapon  and  the  proximity  of  the  hit  m.iy  be  provided  in  the  form 
of  target-structure  alteration,  charring,  fire,  smoke,  or  numerical 
scores.  Special  effects  also  can  be  used  to  depict  weapon  trajectory. 
Highly  realistic  weapons  effects,  such  as  altering  the  structure  of  a 
target,  may  contribute  to  greater  user  acceptance,  but  it  is  unlikely 
that  they  will  result  in  more  effective  training  than  loss  realistic 
effects.  Hence,  it  is  expected  that  the  degree  of  realism  chat  proves 
most  suitable  will  depend  primarily  on  the  modeling  and  computational 
costa  associated  with  the  weapons  effects  generation. 

The  final  class  of  potentially  relevant  special  effects  is  lights. 
Designers  of  CIG  systems  have  considered  the  modeling  of  both  natural 
light  sources  (sun,  moon,  and  stars)  and  cultural  light  sources 
(omnidirectional,  unidirectional,  rotating,  and  flashing).  The  modeling 
of  cultural  light  sources  has  received  considerable  attention  in  the 
development  of  CIG  systems  for  use  in  training  commercial  airline 
aviators,  The  resulting  CIG  scenes  have  proved  to  be  hlglily  effective 
for  training  on  night  landings.  Cultural  lights  arc  less  important:  for 
training  helicopter  aviators  bec.ause,  in  combat  conditions,  cultural 


-!|8  I 

I 

I 


llghcs  cannot  be  expected  to  be  available  In  takeoff  and  landing  areas 
and  cannot  be  expected  to  serve  as  reliable  checkpoints  for  night 
navigation. 

The  visual  information  requirements  analysis  of  night  operations 
should  provide  at  least  preliminary  Information  about  the  need  for  the 
generation  of  light  sources.  Once  decisions  have  been  made  about  the 
types  of  light  sources  that  need  to  be  generated,  additional  research 
will  be  required  to  determine  the  characteristics  and  geographical 
placement  of  each  type  light  source  to  be  generated, 

In  addition  to  the  generation  of  continuous  light  sources, 
attention  must  be  given  to  the  need  for  generating  momentary  light 
sources  required  to  simulate  nuzsle  flashes  of  enemy  weapons  during  both 
daytime  and  nighttime  combat  operations. 


Design  and  Conduct  Psychophysical  Experiments 

The  purpose  of  this  Cask  Is  to  evaluate  empirically  the  relative 
effectiveness  of  Che  candidate  scene-element  designs  developed  during 
Che  course  of  the  preceding  task.  I*:  Is  expected  that  Che  findings  of 
the  psychophysical  research  will  provide  insights  about  how  Co  further 
improve  the  design  of  some  scene  elements,  In  fact,  it  may  be  necessary 
to  iterate  through  the  design  and  evaluation  research  process  several 
times  before  near  optimal  designs  are  produced, 


General  Research  Approach 

In  the  final  analysis,  training  effectiveness  is  the  only  true 
measure  of  Che  effectiveness  of  the  scene  content  of  a  CIG  display. 
However,  at  Che  outset  of  this  research,  there  is  such  a  large  number  of 
design  options  that  it  would  be  an  enormously  expensive  undertaking  to 
evaluate  every  option  through  transf er-of-tralning  experiments.  An 
alternate  approach  is  to  conduct  psychophysical  studies  to  assess  the 
relative  effectiveness  of  alternate  scene-element  designs  and,  subse¬ 
quently,  to  conduct  transfer-of-trainlng  studies  to  determine  whether 
the  scene-element  designs  that  proved  best  in  the  psychophysical  studies 
result  in  effective  training  transfer.  This  approach  assumes  only  that 
psychophysical  procedures  ca'n  be  used  to  assess  the  relative  effective¬ 
ness  of  scene-element  designs  for  training;  no  conclusions  about 
absolute  training  effectiveness  are  made  until  the  transf er-of-training 
experiments  have  been  completed. 


Recommended  Research  Procedures 

Tlie  types  of  judgments  that  helicopter  aviators  must  make  varies 
so  greatly  from  one  task  to  another  that  there  is  no  single  psycho- 
pliysical  research  procedure  that  is  suitable  for  assessing  judgment 


accuracy  for  Che  full  range  of  flying  Casks.  A  sCudy  of  the  Casks 
listed  in  Appendix  A  led  Co  Che  conclusion  Chac  hellcopcer  flying  tasks 
can  be  classified  inCo  three  cacegorles  with  respect  Co  Che  types  of 
judgments  Chac  arc  mosc  critical  to  che  successful  performance  of  Che 
Casks.  A  different  research  procedure  is  required  for  each  of  che  three 
categories  of  Casks. 

All  of  Che  research  described  below  assumes  the  availability  of  a 
CIG  system  that  is  capable  of  generaclng  Che  full  range  of  scene-element 
designs.  T.f  some  scene-element  designs  exceed  Che  capability  of  che  CIG 
system  used  Co  conduct  Che  research,  it  may  be  possible  to  develop 
alternate  ways  to  produce  Che  stimulus  material  needed  to  evaluate  Che 
designs.  One  potentially  feasible  technique  is  to  generace  Che  required 
Imagery  in  non-real-time  and  use  che  imagery  to  produce  a  moCion  picture 
or  video  tape  that  would  simulate  real-time  conditions.  Animation  is 
another  potentially  feasible  approach.  Evan  still  photographs  have  been 
used  successfully  to  investigate  scene  content  requirements  (deCroot, 
1981;  DeHaio  &  Brooks,  1982;  Eisele  et  al. ,  1976;  Roscoe,  1977). 

Judgment  of  flight  parameters.  One  category  of  Casks  requires 
aviators  to  use  Information  gleaned  from  a  dynamic,  extra-cockpit  scene 
Co  make  Judgments  about  one  or  more  of  the  following; 

•  aircraft  position  (vertical,  lateral,  and  longitudinal)  relative 
to  one  or  more  extra-cockpit  referents, 

s  rate  of  change  of  aircraft  position, 

■  aircraft  attitude  (roll,  pitch,  and  yaw)  relative  to  one  or  more 
extra-cockpit  referents,  and 

s  rate  of  change  of  aircraft  attitude. 


A  suitable  research  procedure  for  this  category  of  Casks  must  provide 
valid  and  sensitive  measures  of  the  accuracy  of  position  and  attitude 
judgments  as  scene-element  design  is  varied  systematically.  To  ensure 
maximum  validity,  subjects  must  be  required  to  make  their  judgments  with 
a  dytiamic  rather  tlian  a  static  display.  To  ensure  maximum  sensitivity, 
the  subjects'  Judgments  sliould  not  be  confounded  with  non-vlaual  skills, 
such  ns  aircraft  liaiuillng  skills  and  cognitive  skills.  The  procedure 
that  is  recommended  la  similar  to  the  classical  psycliophysical  method 
sometimes  referred  to  as  Method  of  Adjustment  (Edwards,  1950)  and 

sometimes  referred  to  as  Method  of  Average  Error  (Guilford,  1954).  The 

procedure  requires  that  che  subject  be  given  direct  and  independent 

control  of  each  of  the  three  position  parameters  and  each  of  the  three 
attitude  parameters.  The  subject  would  use  the  controls  to  (a)  adjust 
parameters  to  a  prescribed  value,  (b)  maintain  paL'ameters  at  a  fixed 

value  in  the  face  of  a  realistic  forcing  function,  (c)  adjust  rate  of 
change  of  parameters  Co  a  prescribed  value,  or  (d)  maintain  parameters' 
rate  of  change  in  the  face  of  a  realistic  forcing  function. 
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Each  task  classified  into  the  first  category  must  be  analyzed  to 
determine  the  critical  parameters  that  must  be  judged,  the  "standard" 
(command  value)  for  each  parameter,  and  the  size  of  the  error  tolerance 
for  each  type  of  Judgment.  For  example,  an  analysis  of  the  task 
"Takeoff  to  a  Hover"  shows  that  an  aviator  must  be  capable  of  the 
following  perceptual  Judgments:  (a)  Judge  when  altitude  is  at  a  value 
of  four  feet  (skid  height),  (b)  detect  deviations  of  one  foot  or  more 
from  an  altitude  of  four  feet,  (c)  detect  deviations  of  five  degrees  or 
more  from  a  prescribed  heading,  and  (d)  detect  forward  or  lateral 
deviations  from  a  fixed  position  that  exceed  two  feet.  This  suggests 
the  need  for  psychophysical  studies  to  assess  the  effect  of  scene- 
element  design  on  a  subject's  ability  to  adjust  altitude  to  a  value  of 
four  feet,  null  a  forcing  function  as  necessary  to  maintain  an  altitude 
of  four  feet,  null  a  forcing  function  as  needed  to  maintain  heading  at  a 
prescribed  value,  and  null  forcing  functions  as  necessary  to  maintain  a 
fixed  lateral  and  longitudinal  position, 

Y  Once  all  the  tasks  in  the  first  category  have  been  analyzed  in 

this  manner,  it  will  be  possible  to  develop,  for  each  parameter,  a  table 
that  lists  the  values  of  standards  (positions  and/or  rates)  to  be 
Judged,  the  error  tolerance  for  each  standard,  and  the  type  of  Judgment 
required  for  eech  standard  (adjust  parameter  to  standard  or  detect 
deviation  from  a  standard).  Together,  such  tables  would  specify  the 

full  range  of  Judgments  that  may  be  Influenced  by  the  scene  content  of  a 
GIG  display.  In  designing  the  psychophysical  experiments,  it  will  be 
necessary  to  select  a  email,  representative  sample  of  flight  parameter 

Judgments  to  use  in  assessing  the  relative  effectiveness  of  alternate 

;  scene-el&ment  designs. 

iSxtra-cockpit  feature  detection/identification.  The  critical 
element  of  a  second  category  of  tasks  is  the  detection  and/or 

identification  of  extra-cockpit  features.  Some  tasks  in  this  category 
require  only  that  the  aviator  recognize  a  clearly  visible  object  as 

»  being  :ne  of  a  given  class  or  one  that  has  been  seen  before  and  adopted 

as  a  position  referent.  These  taoks  are  rufarred  to  as  short-range 

object  recognition  tasks.  Research  is  required  to  evaluate  alternate 
designs  for  objects  tliat  arc  to  be  used  to  provide  training  on 
short-range  object  recognition.  The  procedure  recormnended  for  this 
research  is  a  .simple  oner  measure  object  recognition  accuracy  and 

response  latency  as  a  function  of  point-of-regard  viewing  range  and 

object  b.nckground. 

Other  Important  tasks  Included  in  the  second  category  are  long- 
range  target  detection  and  identification.  It  seems  highly  likely  that 
nothing  short  of  high-fidelity  CIO  scene,  elements  would  result  in 

effective  training  on  target  detection  and  identification.  Although  it 
would  be  possible  to  develop  realistically  difficult  target  detection 
and  idcnci f Ication  tasks  using  abstract  targets  and  backgrounds,  it 
seems  unlikely  that  training  with  abstract  scene  elements  would  transfer 
positively  to  a  real-world  setting.  In  fact,  training  with  abstract 
.scene  elements  may  very  well  result  in  perceptual  seC.s  that  are 
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counterproductive.  However i  these  views  are  based  on  suppositions  and 
empirical  research  is  required  to  resolve  the  issue. 

It  seems  probable  Chat  much  could  be  learned  about  Che 
relationship  between  scene-element  design  and  both  short-range  object 
recognition  and  long-range  target  detection  and  Identification  from 
studies  using  stimuli  produced  from  photographs  and  artists'  drawings  of 
selected  scene  elements.  It  Is  recommended  that  the  feasibility  of  such 
research  be  evaluated  and.  If  feasible,  pursued  until  a  suitable  CIG 
system  becomes  available. 

Map/real-world  feature  association.  The  critical  aspect  of  the 
third  category  of  tasks  Is  that  of  associating  extra-cockpit  features 
with  their  counterpart  on  a  topographic  map.  The  criterion  for 
evaluating  the  design  of  all  scene  elements  other  than  terrain  relief  Is 
the  ease  and  accuracy  with  which  a  trained  aviator  can  identify  the  map 
symbol  that  would  be  used  to  portray  the  object  on  a  standard  1:50,000- 
scale  topographic  map.  Accordingly,  the  evaluation  of  alternate  scene- 
element  designs  for  the  third  category  of  tasks  can  be  accomplished  by 
merely  displaying  each  candidate  scene-element  design  and  requesting 
trained  aviators  to  examine  the  feature  and  indicate  on  a  map  legend  the 
symbol  that  most  likely  would  be  used  to  depict  that  feature  on  a  map. 

*  The  technique  used  to  display  terrain  relief  roust  be  evaluated  by 
determining  the  ease  and  accuracy  with  which  trained  aviators  can 
associate  landforma  appearing  on  the  CIG  display  with  their  counterpart 
on  the  map.  To  accomplish  such  an  evaluation,  it  Is  necessary  to  have 
an  accurate  CIG  data  base  for  a  geographic  area  that  has  been  mapped  at 
a  scale  of  1:50,000.  One  procedure  for  evaluating  alternate  techniques 
for  displaying  terrain  relief  Is  to  require  experienced  aviators  to 
examine  terrain  relief  appearing  on  a  CIG  display  and  select  from  four 
or  five  alternatives  the  location  on  the  map  from  which  the  displayed 
terrain  is  visible.  A  second  technique  is  to  assess  the  accuracy  with 
which  trained  aviators  can  maintain  geographic  orientation  using  only 
the  CIG  displayed  terrain  relief  and  a  map.  With  this  procedure,  the 
simulated  aircraft  wuuld  be  flown  along  a  pre-selected  route  and  the 
subject  would  be  required  to  draw  the  flight  path  o:i  the  map. 


Develop  Candidate  CIG  Scene  Models 

M 

The  purpose  of  this  task  is  to  apply  the  insights  and  data 
accumulated  to  this  point  in  the  program  in  developing  a  set  of  CIG 
t:cene  models  for  subsequent  empirical  evaluation.  The  specification  for 
each  scene  model  must  define  at  least  the  following: 

•  the  size  of  the  area  covered  by  the  model, 

•  the  elevation  of  terrain  relief  at  each  point  throughout  the 
model , 

•  the  types  and  locations  of  the  topographic  features  that  appear 
on  tlie  terrain  surface. 


•  the  number  of  levels-of~detai.l  and  the  slant  range  at  which  each 
leve 1-0 f -detail  appears/disappears, 

•  the  types  of  texturing  that  appear  on  each  ground  plane  area* 
and 

•  the  exact  design  parameters  for  each  three-dimensional 
topographic  feature  (including  the  texturing  of  object 
surfaces) . 

Scene  models  that  have  been  developed  for  training  fixed-wing 
aircraft  aviators  have  had  several  '’levels-of-datall, "  That  ist  the 
acene  content  varies  as  a  function  of  viewing  range.  As  viewing  range 
to  an  area  Increases,  the  elements  that  comprise  the  scene  tend  to 
become  larger,  less  detailed,  and  less  dense.  Conservation  of  computer 
computational  capacity  is  one  reason  for  designing  CIG  imagery  with 
different  lovels-of-detail.  Another  reason  is  that  a  high  level-of- 
detall  simply  cannot  be  perceived  from  large  distances.  More  than  one 
level-of-detail  will  be  required  for  CIG  imagery  developed  for 
helicopter  operations.  However,  because  most  helicopter  flight  occurs 
at  low  altitudes,  fewer  levels-of-detail  will  be  required  than  for 
fixed-wing  operations.  Once  the  required  number  of  levels-o£-detall  has 
been  determined,  it  will  be  necessary  to  develop  scene  models  for  each 
level-of-detail. 

The  end  product  of  this  task  is  a  set  of  scene  models  that  vary 
along  a  dimunsion  of  training  capability.  The  Initial  step  In 
accomplishing  this  task  is  to  define  what  is  Judged  to  be  the  least 

costly  scene  model  that  would  have  a  significant  training  benefit.  The 
next  step  is  to  define  a  second  scene  model  that  has  a  training 
capability  that  is  judged  to  be  significantly  greater  than  the  base 
model.  This  procedure  will  be  repeated — with  each  new  scene  model 
having  an  incrementally  greater  training  capacity  than  the  preceding 
acene  model — until  a  scene  model  is  developed  that  has  the  greatest 

training  cap.nblllcy  that  the  CIG  technology  will  allow.  It  is  expected 
that  between  six  and  12  scene  models  will  be  required  to  cover  the  full 
continuum  of  tv.ilnlng  capability. 

At  this  point  in  the  project,  little  will  be  known  about  training 
effectiveness  as  such.  So,  judgments  about  the  training  capability  of  a 
given  scene  model  will  have  to  be  baaed  more  on  predictions  about  number 
of  different  tasks  that  can  be  trained  with  the  scene  model  than"predic- 
tlons  about  the  effectiveness  with  which  a  given  task  can  be  trained. 
Without  question,  considerable  subjectivity  will  enter  into  the  judg¬ 
ments.  However,  tiie  previous  tasks  should  yield  a  considerable  amount 
of  information  and  performance  data  that  will  bring  some  degree  of 

objectivity  to  the  judgments.  First,  much  will  be  known  about  the 

information  that  aviators  must  extract  from  the  extra-cockpit  scene  in 
order  to  perform  eact\  training  task.  Secondly,  the  psychophysical 
experiments  will  .serve  to  identify  scene-c.1  cment  designs  that  enable 
aviators  to  make  gcriiinne  perceptual  judgments  and  will  provide  in-depth 
knowledge  about  the  accuracy  with  which  the  perceptual  judgments  can  be 


k 


made.  Finally)  an  updated  assessment  of  CIG  technology  will  provide  the 
information  needed  to  make  judgments  about  the  feasibility  of 
generating)  in  real  time)  the  scene  elements  that  comprise  a  given  scene 
model. 


Once  the  candidate  scene  models  have  been  developed,  each  member 
of  a  team  of  subject  matter  experts  will  be  required  to  Identify,  for 
each  training  task,  the  least  complcx/costly  scene  model  that  will 
provide  effective  training.  The  subject  matter  experts  also  will  be 
required  to  identify  tasks  that,  in  their  opinion,  cannot  be  trained 
with  each  scene  model. 


Identify  Critical  Parameters  of  Display  Subsystem 

It  is  generally  recognized  that  the  effectiveness  of  an  entire  CIG 
system  can  be  influenced  by  qualities  of  the  display  subsystem,  such  as; 
fleld-of-view,  resolution,  brightness,  contrast,  distortion,  tonal 
range,  and  color  rendition.  It  would  be  of  academic  Interest  to 
investigate  the  relationship  between  each  display  quality  and  training 
effectiveness,  but  to  investigate  display  qualities  as  independent 
variables,  along  with  scene  models,  would  greatly  increase  the  cost  of 
this  program  of  research.  1'  .'’.earns  likely  that  cost  considerations  will 
dictate  that  the  research  be  limited  to  display  subsystem  components 
that  have  a  significant  Impact  on  total  system  cost.  This  assumption  is 
explained  more  fully  below. 


There  have  been  continuing  efforts  to  develop  display  components 
that  improve  the  quality  of  the  image,  and  there  is  no  reason  to  believe 
that  such  efforts  will  cease  in  the  foreseeable  future.  It  can  be 
expected  that,  in  some  instances,  improvements  in  image  quality  can  be 
achieved  with  new  hardware  components  that  cost  little  more  than  the 
older  components.  In  such  instances,  no  research  is  required  to 
determine  that  the  new  component  is  more  cost  effective  than  the  old 
one.  It  is  only  when  new  components  cost  appreciably  more  tluin  tl\e 
older  ones  that  research  is  required  to  determine  whether  tlie  .idded 
tr.sinlng  betiofits  of  the  new  component  outwclRhs  it.s  added  costs. 


Thus,  the  purpo.se  of  this  task  is  to  identify  di.splay  components 
whose  cost  effectiveness  cannot  be  assessed  without  data  on  the 
component's  training  effectiveness.  It  this  research  pnjp.ram  was 
Initiated  at  the  time  of  this  writing,  it  probably  would  be  necessary  to 
collect  training-effectiveness  data  to  assecs  tlie  cost  e f foe t i venes.s  of 
such  components  as  light  valve  projectors,  Area-of-Interest  (AOI.) 
display  systems,  and  large  f  ield-of-vi  ew  optlc.s.  By  the  time  this 
research  program  is  initiated,  however,  the  production  cost  of  trese 
components  may  be  so  small  that  no  research  will  be  required  to 
establish  their  cost  effectiveness. 


Develop  Efficient  Instructional  Methods 

The  various  visual-rystem  configurations  must  be  evaluated  in 
terras  of  training  effectiveness,  so  it  is  necessary  to  develop  methods 
to  use  in  training  the  Individuals  who  serve  as  subjects  in  this 
research.  It  is  essential  chat  training  methods  be  used  chat  are  known 
to  be  effective;  otherwise,  the  deleterious  effects  of  ineffective 
training  methods  could  totally  mask  important  differences  between 
visual-system  configurations.  A  literature  search  revealed  only  a  few 
studies  aimed  at  the  developraeat  and/or  evaluation  of  flight  simulator 
training  methods.  Even  fewer  studies  were  located  that  addressed  the 
question  of  training  effectiveness  for  simulators  equipped  with  a  CIG 
display.  The  few  studies  Chat  have  addressed  training  methodr  in  flight 
simulators  have  limited  value  for  present  purposes  because  they  dealt 
with  fixad“Wlng  aircraft. 

Since  little  is  known  about  how  best  to  train  Array  aviators  in 
flight  simulators  equipped  with  a  CIG  system,  it  is  recommended  that  n 
systematic  program  of  research  on  this  important  topic  be  initiated  as 
soon  as  possible.  The  recommended  research  program  is  described  In 
detail  later  in  this  section.  It  is  assumed  Chat  much  of  the  research 
on  instructional  methods  must  be  completed  before  it  will  be  possible  to 
•'uitlate  research  to  evaluate  the  training  effectiveness  of  alternate 
visual  systems. 

Design/Conduct  Experiments  on  Visual-System  Configurations 

It  le  impoasible  to  specify  at  this  time  the  design  of  the 
specific  experiments  that  will  be  required  to  assess  the  candidate 
visual-systeu  configurations.  However,  It  is  possible  to  discuss 
critical  requirements  that  must  be  met  by  the  research  and  to  discuss 
some  of  the  factors  that  make  it  difficult  to  design  and  conduct 
research  that  will  fulfill  these  requirements. 

A  key  requirement  is  that  the  research  be  designed  to  provide  the 
transfer-of-cralning  data  and  the  continuation-training  effectiveness 
data  that  are  needed  to  make  a  quantitative  assessment  of  the  cost 
effectiveness  of  alternate  visual-system  configurations.  As  has  been 
stated  earlier,  traasfer-of-traluing  experiments  disrupt  the  training 
syscera  and  are  both  costly  and  time-consuming  to  conduct.  Pesearch  to 
assess  the  utility  of  simulators  for  maintaining  the  skills  of  trained 
aviators  may  ha  even  more  disruptive  and  costly  than  transfer-of- 
training  research.  The  reason  is  that  a  valid  assessment  of  the  utility 
of  simulators  for  skill  malnten.ance  is  not  possible  without  restricting 
or  curtailing,  for  the  duration  of  the  research,  the  aircraft  flying 
time  of  the  aviators  who  serve  as  subjects.  For  obvious  reasons, 
command  personnel  at  all  levels  are  reluctant  to  support  such  research. 
Because  of  the  extremely  high  cost  of  transf  er-of-training  and 
continu.ition-trainlng  effectiveness  research,  every  attempt  must  be  made 
to  reduce  tlie  number  of  conditions  tliat  must  be  investigated  with  these 
methods . 


A  second  imporcaut  requirement  of  this  research  is  that  training 
transfer  and  continuation-training  effectiveness  be  examined  on  a  task~ 
by-task  basis.  There  are  two  reasons  for  this  requirement.  First, 
there  is  certain  to  be  a  powerful  interaction  between  tasks  and  visual- 
system  configurations.  The  visual  systems  will  vary  in  Che  number  of 
tasks  for  which  training  can  even  be  attempted.  By  design,  the  lower 
cost  CIG  scene  models  will  lack  the  scene  elements  needed  to  train  some 
tasks.  The  visual  systems  also  may  vary  in  the  relative  effectiveness 
with  which  a  given  task  can  be  trained.  That  is,  for  tasks  chat  can  be 
trained  on  two  or  more  of  the  visual-system  configurations,  the  rate  of 
skill  acquisition  may  vary  widely  from  one  configuration  to  another. 

It  is  essential  that  task-by-conf Iguration  interactions  be  taken 
into  account  when  assessing  Che  cost  effectiveness  of  alternate  visual- 
system  configurations.  Computations  of  the  cost  effectiveness  of  a 
given  visual-system  configuration  should  be  based  only  on  Che  Casks  that 
can  be  trained  reasonably  effectively  with  that  configuration. 
Otherwise,  it  is  predetermined  that  the  lower  cost  configurations  will 
be  less  cost  effective  than  Che  higher  cost  configurations.  Ideally, 
training-effectiveness  data  would  be  available  to  calculate  the  cost 
effectiveness  of  a  visual-system  configuration  assuming  training  on 
different  combinations  of  tasks. 

A  second  reason  for  the  need  to  examine  training  effectiveness  on 
a  task-by-task  basis  stems  from  the  fact  that  the  effectiveness  of 
training  on  any  given  flying  task  may  be  influenced  greatly  by  the  types 
of  tasks  trained  previously  and  the  effectiveness  with  which  these  casks 
have  been  trained.  Helicopter  flying  tasks  are  trained  in  a  fixed 
sequence  because  it  is  assumed  that  skills  on  some  tasks  cannot  be 
acquired  effectively  until  other,  more  basic,  tasks  have  been  mastered, 
If  an  adequate  level  of  a  basic  skill  is  not  acquired,  Che  training  on 
more  advanced  tasks,  which  are  dependent  on  that  basic  skill,  will 
appear  Ineffective,  For  example,  training  on  hovering  turns  would 
appear  ineffective  if  the  ctudent  has  had  Inadequate  training  on 
stationary  hover,  A  failure  to  consider  the  interdependencies  among 
tasks  could  result  in  serious  misinterpretations  of  Che  data  which,  in 
turn,  would  lend  to  erroneous  conclusions  about  the  cost  effectiveness 
of  alternate  visual-system  configurations. 

The  considerations  discussed  above  suggest  a  need  to  conduct  at 
least  two  different  types  of  studies  at  this  stage  in  the  research 
program . 


In-Slmulator  Skill  Acquisition  Studies 

The  objective  of  the  first  type  of  study  is  to  examine  the  rate 
and  level  of  skill  acquisition  in  the  simulator.  Although  skill 
acquisition  in  the  simulator  does  not  necessarily  mean  that  an  aviator 
tiainoe  is  acquiring  transferable  skills,  It  appears  reasonable  to 
assume  that  a  lack  of  improvement  of  performance  in  the  simulator  is  an 


indication  that  the  aviator  trainee  is  not  acquiring  transferable 

sklllsi  If  this  assumption  is  valid,  task-by-task  data  on  the  rate  and 
level  of  skill  acquisition  in  the  simulator  should  serve  to  Identify  (a) 
tasks  that  cannot  be  trained  effectively  with  a  given  visual-system 

configuration,  (b)  Instances  In  which  the  simulator  training  time 
allocated  to  a  given  task  Is  not  great  enough  to  permit  the  aviator 
trainee  to  become  fully  proficient  at  chat  task,  and  (c)  training  that 
is  ineffective  because  the  aviator  trainee  failed  to  acquire  important 
prerequisite  sklLlSr  Data  of  potential  value  include: 

•  the  race  of  skill  acquisition  in  the  simulator  relative  to  Che 
rate  at  which  the  seme  skill  is  acquired  in  the  aircraft, 

•  the  level  of  skill  achieved  by  aviator  trainees  relative  to  the 
simulator  performance  level  of  fully  trained  aviators,  and 

•  the  extent  to  which  training  on  lower  fidelity  visual-system 

configurations  transfer  to  performance  with  the  highest  fidelity 
visual-system  configuration  investigated  (see  Westra,  1902,  for 
a  dlncusslon  of  In-slmulator  transf er-of-trainlng) . 

Tranafet-of-Trainlng  Studies 

As  Indicated  earlier,  Che  objective  of  Che  second  type  of  study  is 
to  measure  the  extent  to  which  training  in  the  simulator  transfers  to 
Che  aircraft.  There  is  a  need  to  monsure  the  transfer  of  both  skill 
acquisition  and  skill  maintenance  training,  The  methodology  used  in 

Ctadicional  transfer-of -training  research  is  discussed  in  detail  by 

Roscoe  and  his  associates  (Roscoe,  1980),  However,  there  are  two 

important  Issues  that  are  not  addressed  either  by  Roscoe  or  other 
researchers.  The  first  issue  Is  the  measurement  of  training  transfer  on 
a  task-by-task  basis.  Casual  consideration  suggests  that  the  relative 
task-by-task  transfer  effectiveness  of  different  visual-system 

configurations  could  be  measured  by  first  training  an  aviator  to 

cviterlon  in  the  simulator  and  then  determining  the  number  of  practice 
iterations  in  the  aircraft  the  aviator  requires  to  reach  a  criterion 
level  of  performance  in  the  aircraft.  Upon  closer  inspection,  however, 
it  becomes  .apparent  that  this  appro.-ich  has  mimerouK  methodological  and 
practical  problems  that  must  be  overcome  before  it  can  be  recommended.'' 
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The  second  Issue  concerns  the  methodology  for  assessing  the 
of  fectivenes.s  of  simulator  training  for  skill  maintenance.  Not  one 
study  was  located  in  the  literature  that  sheds  light  on  the  L -.at 
methodology  for  assessing  the  continuation-training  effectiveness  of 
simulators.  The  development  of  a  suit.nble  metliodology  is  complicated  by 
the  general  lack  of  knowledge  about  the  rate  at  which  different  types  of 
flying  skills  decay  if  not  practiced.  it  seem.s  reasonable  to  assume 

''See  page  b  1  for  a  detallci!  discussion  of  the  problems  .associated  with 
measuring  training  transfer  .ui  .a  t.isk-hy-t.-isk  l),isis. 


chat  a  suitable  methodology  will  require  that  experimental  groups  be 
employed  as  necessary  to  measure  the  main  effects  and  interactions  of  at 
least  the  following  variables: 

«  the  initial  skill  level  of  the  aviator, 

•  the  length  of  the  no-practice  period,  and 

•  Che  type  and  amount  of  simulator  practice  the  aviator  receives. 

Before  research  is  Initiated  to  measure  the  effects  of  visual-system 
configuration  on  continuation-training  effectiveness,  it  will  be 
necessary  to  conduct  preliminary  research  to  establish  appropriate 
values  for  the  length  of  the  no-practlce  pariod(s)  to  be  investigated 
and  the  amount  of  simulator  training  to  be  administered  at  the  end  of 
the  no-practice  period.  Obviously,  the  relative  effectiveness  of 
different  visual-system  configurations  could  not  be  assessed  adequately 
if  aviators  did  not  refrain  from  practice  long  enough  for  their  flying 
skills  to  decay  appreciably.  Similarly,  the  effectiveness  would  be 
reduced  if  aviators  received  coo  much  or  too  little  simulator  training 
at  the  end  of  the  no-practice  period. 


Identify  Most  Cost-Effective  Media  Mix 

Once  the  research  to  assess  the  training  effectiveness  of 
alternative  visual-system  configurations  has  been  completed,  it  is 
recommended  that  the  research  results  and  other  required  data  be  used  in 
an  analysis  to  identify  the  most  cost-effective  mix  of  training  devices 
for  accomplishing  skill  acquisition  training  (lERW  and  transition)  and 
continuation  training.  A  less  complicated  and  less  costly  analysis 
could  be  conducted  to  determine  only  the  relative  cost  effectiveness  of 
alternative  visual-system  configurations.  However,  limiting  the  cost- 
effectiveness  analysis  to  visual-system  configurations  almost  surely 
would  lead  to  erroneous  decisions  about  the  optimal  allocation  of 
training  resources—partlcularly  with  respect  to  part-task  training 
dev  Ices . 

Even  now,  it  Js  possible  to  concep  tUri  1  Ir  e  low-cost,  part-tnor' 
trainlug  devices  tliat  may  be  effective  for  trnining  some  of  the  flying 
tasks  that  impose  the  greatest  demands  on  a  CIG-hased  vlvSual  system. 
Target  detectlon/ldentif icatii  i  and  NOE  navigation  are  the  two  prime 
examples.  As  the  research  on  visual  systems  is  conducted,  the 
researchers  undoubtedly  will  conceptualize  other  potentially  effective 
training  alternatives. 

Figure  3  shows  that  four  other  tasks  must  be  accomplished  in  order 
to  compile  the  data  and  refine  the  methodology  for  optimal  mix  analyses. 


Compile  Visual-System  Cost  Data 

First,  it  is  necessary  to  compile  accurate  cost  data  for  each 
visual-system  conf Igurrit i on .  Tlicse  data  must  Include,  for  e.icl)  visual- 


system  configuration,  both  the  life-cycle  coat  of  the  hardware  and  the 
coat  of  compiling  the  data  base  required  to  support  each  visual-system 
configuration.  The  types  of  cost  data  that  must  be  compiled  is 
described  in  the  Department  of  Defense  Life  Cycle  Costing  Guide  (DoD, 
1973).  Generally,  the  requirements  Include  "initial"  costs  (procurement 
costs)  and  "consequential"  costs  (cost  of  ownership,  support  costs,  or 
operations  and  maintenance  costs).  Cost  data  for  individual  components 
of  the  dliiiplay  subsystem,  the  image  generator  subsyetero,  and  the  data¬ 
base  subsystem  would  be  useful  for  identifying  cost  drivers,  but 
component  costs  are  not  essential  for  performing  the  recommended 
cost-effectiveness  analyses. 

It  is  expected  that  the  most  difficult  part  of  compiling  visual- 
system  coat  data  will  be  that  of  estimating  the  cost  of  a  CIG  that  is 
specifically  designed  to  generate  the  Imagery  for  one  or  a  set  of 
prescribed  scene  models.  It  is  extremely  unlikely  that  any  CIG  avail¬ 
able  on  the  market  at  the  time  the  research  is  completed  will  be  found 
to  be  suitable.  Even  though  an  existing  CIG  may  be  capable  of 
generating  the  required  scene  content,  it  is  probable  that  the  device 
would  have  unneeded  capabilities  and  capacity  that  the  Army  would  be 
reluctant  to  pay  for.  If  this  expectation  proves  valid,  it  will  be 
necessary  to  estimate  the  cost  of  a  CIG  that  has  not  yet  been  designed. 
No  easy  solution  to  this  problem  is  apparent  at  this  time.  In  the 
absence  of  historical  data,  the  only  alternative  may  be  to  contract  with 
CIG  vendors  to  produce  a  preliminary  design  in  sufficient  detail  to 
enable  estimates  to  be  made  of  the  life-cycle  costs. 


Develop  Improved  Cost  Models 

Second,  it  will  be  necessary  to  develop  Improved  models  for 
assessing  cost  effectiveness.  The  primary  need  is  for  cost- 
effectiveness  analysis  models  that  (a)  take  Into  account  certain  costs 
and  benefits  not  considered  by  existing  models,  and  (b)  Identify  the 
most  cost-effective  mix  of  training  media  (including  the  aircraft, 
slmulator.s,  procedures  trainers,  part-task  trainers,  and  classroom 
instruction)  for  aircrew  training  on  specific  tasks.  This  need  is 
discussed  in  detail,  in  a  later  subsection  of  Section  11  (entitled  Co.st- 
Kf fectiveness  Analysis  Models).  The  only  point  that  needs  to  be  made  at 
this  point  is  that  substantial  progress  has  been  made  in  developing 
linear  optimization  model.s  for  use"ln  evaluating  flight-training  systems 
(Marcus,  Patterson,  Bennett,  4  Gersham,  1980).  Linear  programming 
techniques  are  ideally  suited  to  the  problem  of  evaluating  the  cost 
effectiveness  of  all  permutations  of  large  numbers  of  training  media 
options,  each  of  which  has  different  training  capabilities  and  costs. 


Compile  Data  on  Costs  of  Training  in  the  Aircraft 

Third,  It  will  be  neces.sary  to  compile  up-to-date  data  on  the  cost 
of  training  each  task  in  the  alrcr.aft.  Presumably,  the  Army  maintains 


accurate  data  on  flying-hour  costs  for  each  aircraft  type,  but  It  will 
be  necessary  to  conduct  additional  research  to  derive  accurate  estimates 
of  the  amount  of  flying  time  the  average  student  requires  to  learn  each 
training  task. 

Compile  Data  on  Training  Effectiveness  and  Cost  of  Alternate 

Training  Hethods/Medla 

Finally,  it  will  be  necessary  to  compile  data  with  which  to 
estimate  the  training  effectiveness  and  the  cost  of  ground-based 
training  methods  and  media  other  than  CIC  based  flight  simulators. 
Again,  coan-  and  training-effectiveness  data  must  be  derived  for 
individual  flying  tasks.  Data  for  existing  components  of  the  training 
system  can  be  derived  by  analysing  historical  cost  data;  trans£er-of- 
tralnlng  renearch  will  be  required  to  assess  the  training  effectiveness 
of  existing  components  of  the  training  system.  It  will  be  more  diffi¬ 
cult  to  estimate  the  costs  and  training  effectiveness  of  potentially 
useful  alternatives  to  aircraft  or  simulator  training  that  have  been 
conceptualized  but  not  yet  developed.  In  such  cases,  it  will  be 
necessary  to  either  develop  and  evaluate  prototypes  of  candidate  devices 
or  to  use  the  best  information  available  to  dnrive  cost-  and  training- 
effectiveness  estimates, 


Summary 

In  summary,  the  analysis  to  identify  the  most  cost-effective  media 
mix  requires  inputs  from  the  tasks  listed  below  and  shown  schematically 
in  Figure  3! 

•  Design/conduct  research  on  visual-system  configurations. 

•  Compile  cost  data  for  visual-system  components. 

•  Assess  cost  of  in-aircraft  training. 

•  Develop  Improved  cost-effectiveness  analysis  models. 

t  As.ycss  effectiveness/cost  of  ocher  ground-based  training 
raethods/mcdla . 

The  primary  benefit  of  this  analysis  is  the  quantification  of  the 
cost  effectiveness  of  each  media  mix  that  is  capable  of  accomplishing 
the  full  set  of  training  objectives.  In  addition,  the  analytic  results 
will  be  useful  for  identifying  the  components  of  the  visual,  system  that 
have  the  greatest  Impact  on  training-system  cost.  When  it  is  not 
possible  to  derive  accurate  estimates  of  the  cost  and/or  training 
effectiveness  of  training-system  components  that  have  not  yet  been 
designed,  this  technique  can  be  used  to  conduct  sensitivity  analyses  to 
determine  the  sensitivity  of  total  system  cost  tn  variations  in  the  cost 
and  training  ef f ect Ivenuss  of  training-system  components. 


AO 


PRODUCTS  OF  RESEARCH  ON  VISUAL  SYSTEMS 


Figure  3  shows  thac  the  results  of  the  research  described  above 
will  enable  Army  personnel  to  formulate  detailed  design  requirements  for 
CIG-based  visual  systems,  specify  the  requirements  for  In-alrcraft 
training,  and  specify  requirements  for  other  ground-based  training.  In 
addition,  the  research  findings  will  enable  researchers  to  Identify 
necessary  training  that  cannot  be  accomplished  effectively  either  In  the 
aircraft  or  In  a  simulator  equipped  with  the  visual  system  that  la 
recommended,  The  unfulfilled  training  requirements  will.  In  turn,  serve 
to  Identify  requirements  for  technological  Innovation. 


I  FIDELITY  REQUIREMENTS  FOR  MOTION  SYSTEM 

INTRODUCTORY  COMMENTS 

I 

t 

i  The  Problem 

All  the  flight  simulators  in  the  Army's  Synthetic  Flight  Training 
System  (SFTS)  inventory  are  equipped  with  a  platform  motion  system. 
Moreover,  the  design  requirements  for  the  AH-64  simulator  call  for  a 
full  six  degrees-of-f reedom  motion  platform  that  is  capable  of  providing 
cues  of  motion  and  vibration  associated  with  both  normal  conditions  and 
the  onset  of  emergency  conditions  for  the  helicopter  (Department  of  the 
Army,  TDR  0027,  1981),  Despite  the  Army's  implicit  endorsement  of 
motion  systems,  there  are  no  empirical  data  chat  clearly  establish  the 

1^  cost  effectiveness  of  platform  motion  systems  for  any  Army  flight 

simulator.  In  fact,  the  results  of  recent  research  provide  reasons  to 
doubt  the  cost  effectiveness  of  equipping  helicopter  flight  simulators 
with  platform  motion  systems. 

Numerous  studies  have  been  conducted  to  assess  Che  training 
benefits  of  platform  motion.  An  excellent  review  and  critique  of  the 
literature  on  motion  systems  has  been  conducted  by  Semple  et  al. 
(1981a).  Researcli  conducted  since  Semple  and  his  colleagues  published 
their  work  was  reviewed  prior  to  preparing  this  plan.  The  results  of 
most  research  conducted  to  d,ate,  especially  trnnsl:er-of-training 
research,  indicate  that  little  training  benefit  results  from  platform 
motion.  Although  these  findings  constitute  sufficient  justification  for 
questioning  the  cost  effectiveness  of  platform  motion  on  Army  flight 
simulators,  the  findings  are  not  sufficiently  conclusive  to  justify  the 
conclusion  that  the  Army  should  eliminate  the  use  of  motion  systems  on 
existing  and  future  flight  simulators.  Listed  below  are  reasons  why  the 
current  body  of  research  findings  does  not  justify  definitive 
conclusions  about  the  need  for  motion  systems  on  helicopter  flight 
simulators : 

•  Nearly  all  the  research  on  the  training  benefits  of  simulator 
motion  has  been  conducted  In  fixed-wing  aircraft,  simulators. 
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•  Much  of  the  inotloti  system  research  has  dealt  only  with  skill 
acquisition  in  the  simulator. 

•  The  lack  of  evidence  that  motion  systems  increase 
transfer-of-tralning  may  be  due  to  unacceptably  large  lags  in 
the  motion  systeina,  problems  in  the  drive  algorithms,  the  use  of 
insensitive  performance  measures,  or  some  combination  of  these 
factors. 

•  The  transfer-of-tralnlng  research  investigated  only  tasks  in 
which  motion  feedback  is  the  direct  result  of  pilot  control 
inputs;  no  tasks  were  Investigated  for  which  simulator  motion  is 
a  joint  function  of  control  inputs  and  disturbances  outside  the 
pilot-aircraft  control  loop. 

So,  the  problem  is  this.  There  is  compelling  evidence  that  it  may 
not  be  cost  effective  to  equip  helicopter  simulators  with  platform 
motion  systems.  And  yet,  the  case  against  platform  motion  is  not  strong 
enough  to  justify  a  decision  to  discontinue  the  use  of  platform  motion 
systems  for  existing  and  future  flight  simulators.  A  systematic  program 
of  research  on  motion  systems  is  required  to  resolve  this  issue. 


Types  of  Motion  Cues 

Gundry  (1976)  has  distinguished  between  two  types  of  motion  cues 
that  may  have  an  altogether  different  effect  on  skill  acquisition  in  a 
flight  simulator.  He  defined  maneuver  motion  as  the  motion  chat  arises 
within  the  control  loop.  Maneuver  motion  is  the  direct  result  of 
control  inputs  the  pilot  introduces  to  change  aircraft  attitude, 
position,  or  velocity.  The  feedback  provided  by  maneuver  motion  is 
predictable  and  fully  expected  by  the  aviator,  so  does  not  necessarily 
convey  new  information  to  the  aviator.  The  second  type  of  motion  which 
Gundry  (1976)  refers  to  as  disturbance  motion  results  from  forces 
arising  outside  Che  control  loop  and,  therefore,  is  unexpected  by  the 
aviator , 

Caro  (1979)  distinguishes  between  two  types  of  disturbance  ni;ir.ion: 
correlated  and  uncorrelaCed  disturbance  motion.  Cot:  re.l  a  ted  disturbance 
motion  is  motion  chat  results  from  aircraft  equipment  malfunctions  or 
failures.  Examples  of  correlated  disturbance  motion  for  helicopters  ere 
(a)  the  marked  increase'  in  vertical  alrfiime  vibration  associated  with 
the  main  rotor  being  out-of-track,  (b)  the  sudden  yaw  to  the  left 
associated  with  a  partial  or  complete  loas  of  power,  (c)  the  high 
frequency  airframe  vibration  associated  with  an  out-of-halance  tail 
rotor,  and  (d)  the  violent  pitch  down,  ynw  right,  and  roll  left 
associated  with  t!ie  loss  of  tail  rotor  components.  When  such  malfunc¬ 
tions  occur,  aviators  must  learn  to  diagnose  correlated  motion  quickly 
and  to  initiate  the  appropriate  control  actions  promptly  li  they  are  to 
be  successful  in  avoiding  a  serious  accident. 
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Uncorrelated  disturbance  motion  is  motion  that  is  uncorrelated 
with  both  aviator  control  Inputs  and  aircraft  malfunctions.  Turbulence 
is  the  most  common  source  of  uncorrelated  disturbance  motion.  But 
uncorrelated  disturbance  motion  also  results  from  vehicle  instability, 
normal  engine  vibrations,  and  normal  airframe  oscillations.  Disturbance 
motion  cues  provide  information  to  the  aviator  chat  may  or  may  not  be 
redundant  with  information  available  in  Che  visual  scene. 


Hypothesized  Training  Benefits  of  Motion 

The  identification  of  potential  training  benefits  of  motion  is  a 
necessary  first  step  in  designing  research  to  assess  Che  cost  effective¬ 
ness  of  motion  systems.  Hypothesized  benefits  are  expressed  below  in 
the  form  of  questions.  The  questions  posed  below  represent  theoreti¬ 
cally  possible  but  not  necessarily  probable  training  benefits  of  motion. 
Indeed,  although  the  research  findings  presently  available  are  by  no 
means  conclusive,  they  make  it  difficult  to  be  optimistic,  thst  motion 
will  result  in  any  significant  benefit  for  either  skill  acquisition  or 
skill  sustainment  training. 


1 ,  Does  maneuver  motion  in  a  rotary-wing  flight  simulator  enhance 
learning  of  the  fundamental  relationships  between  control  Inputs  and 
aircraft  responses?  As  was  stated  above,  most  of  Che  research  that  has 
been  designed  and  conducted  to  assess  the  effects  of  motion  on  skill 
acquisition  in  the  simulator  and  training  transfer  from  the  simulator 
has  dealt  mainly  or  exclusively  with  maneuver  motion.  There  have  been 
no  instances  in  which  maneuver  motion  has  been  shown  to  enhance  skill 
acquisition  in  or  training  transfer  from  a  fixed-wing  aircraft 
simulator.  The  presence  of  maneuver  motion  has  failed  to  enhance  the 
transfer  of  simulator  training  on  (a)  aerobatics  (Martin  S  Waag,  1978a), 
(b)  spin,  stall,  and  recovery  from  unusual  attitudes  (Ince,  Williges,  & 
Roscoe,  1975),  (c)  air-to-air  weapons  delivery  (Gray  &  Fuller,  1977), 

(d)  terrain  following  and  avoidance  (Parrish,  Houck,  4  Martin,  1977), 

(e)  air-to-air  combat  (Pohlmann  A  Reed,  1978),  (e)  basic  contact 
approaches  and  landings  (Martin  4  W.iaf;,  197Rb),  and  (f)  formation  flight 
(Woodruff,  Smith,  Puller,  ft  Weyor,  197fi). 


Only  two  studies  h.ave  been  located  that  were  designed  to  assess 
the  extent  to  which  motion  benefits  performance  in  a  rotary-wing  flight 
simulator.  A  .study  by  Fedderson  (1962)  showed  that  motion  re, suited  in  S' 
small  but  statistically  reliable  Increase  in  both  rate  of  skill  acquisi¬ 
tion  in  the  simulator  and  tran.«?fer-of-trainlng  to  the  aircraft. 
Fedderson' s  research,  however,  w.is  limited  to  a  single  flying  task: 
hovering,  The  second  study,  conducted  recently  by  Ricard  and  his 
associates  (Ricard,  Parrish,  Ashworth,  4  Wells,  1981),  was  designed  to 
assess  the  effects  of  both  platform  motion  and  G-seat  motion  on 
experienced  avl-itor-s'  ability  to  maintain  n  fixed  hover  position  above  a 
simulated  ship.  It  w.ns  found  that  per f orin.ance  was  better  with  platform 
motion  than  with  C-sent  motion,  .md  that  performance  with  R-seat  motion 
was  better  than  performance  with  no  motion. 
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The  two  studies  cited  above  suggest  that  performance  In  a  rotary- 
wing  flight  simulator  is  affected  differently  by  motion  than  performance 
in  fixed-wing  flight  simulators.  However,  there  are  at  least  three 
explanations  for  this  difference.  First,  and  most  relevant  to  the 
hypothesis  discussed  here,  it  is  possible  that  maneuver  motion  cues  are 
more  beneficial  for  training  in  a  rotary-wing  than  in  a  fixed-wing 
flight  simulator.  Second,  the  difference  may  result  from  the  presence 
of  disturbance  motion  stemming  from  helicopter  instability  during  hover 
flight.  This  explanation  is  compatible  with  the  thesis  chat  disturbance 
motion  cues  are  Important  for  simulator  training,  but  Chat  maneuver 
motion  cues  are  not.  A  third  explanation  for  Che  differences  is  that 
Che  visual  cues  available  In  the  fixed-wing  simulators  were  more 
adequate  for  the  task  at  hand  than  were  the  visual  cues  in  the  rotary- 
wing  simulators.  Ricard  et  al.  (1981)  used  a  display  with  a  Au ' 

horizontal  by  36“  vertical  f leld-of-vlew.  The  absence  of  a  wide  field- 
of-view  visual  display  made  the  determination  of  the  altitude  and 
fore/aft  translation  so  difficult  that  it  was  necessary  to  add  a  head-up 
display  (HUD)  to  supply  position  information.  Fedderson  (1962)  employed 
a  rudimentary  contact  analog  display  that  had  a  f ield-of-view  of  37®  by 
37®.  Fedderson  also  found  it  necessary  to  supplement  the  basic  display 
with  a  hovering  altimeter.  This  interpretation  Is  compatible  with  the 
thesis  Chat  motion  cues  are  not  necessary  for  training  if  adequate 

visual  cues  are  available  (Cyrus,  1978),  and  that  motion  cues  may  help 

fill  the  Information  gap  if  Che  visual  cues  are  inadequate  for  the 

flying  Cask  at  hand  (Irish,  Grunzke,  Gray,  &  Waters,  1977). 

Based  upon  the  research  findings  available  at  this  time,  a  best 
guess  is  chat  maneuver  motion  does  not  enhance  training  in  rotary-wing 
flight  simulators— especially  a  flight  simulator  equipped  with  a  wide 
f ield-of-vlew  visual  system.  However,  it  will  be  necessary  to  conduct 
further  research  before  it  Is  possible  to  confidently  reject  the  null 
hypothesis  that  maneuver  motion  In  a  rotary-wing  flight  simulator 

enhances  learning  of  the  basic  relationships  between  control  Inputs  and 
aircraft  response.  In  order  to  test  this  hypothesis.  It  will  be 

necessary  to  investigate  aircraft  types  and  tasks  for  which  aircraft 

instability  Is  at  a  minimum.  Otherwise,  the  maneuver  motion  will  be 
confounded  with  the  disturbance  motion  that  results  from  aircraft 

Instability . 

2 .  Does  the  presence  of  maneuver  motion  and/or  disturbance  motion 
early  in  training  interfere  with  skill  acquisition  in  the  simulator? 
Anecdotal  evidence  provided  by  experienced  IPs  indicates  that  the  use  of 
platform  motion  early  In  training  may  actually  interfere  wicli  skill 
acquisition  in  the  simulator.  The  IPs  report  that,  early  in  training, 
the  maneuver  motion  resulting  from  unskilled  students'  control  inputs 
tend  to  be  so  severe  that  the  resulting  platform  motion  often  is 
distracting.  For  Instance,  pilot  induced  oscillations  severe  enough  to 
produce  violent  platform  motion  reportedly  are  encountered  frequently 
whijti  tr.Tlnlnp  students  In  a  simulator.  No  research  he.Trlng  on  this 
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3-  Does  the  presence  of  uncorrelated  disturbance  motion  In  a 
rotary-wing  simulator  Increase  significantly  the  rate  at  which  trainees 
learn  to  cope  with  turbulence  in  the  aircraft?  Turbulent  conditions 
Increase  the  difficulty  of  the  aircraft  control  cask  and  increase  the 
Information  processing  load  on  Che  operator  particularly  when  flying  at 
low  altitude,  when  operating  in  confined  areas,  or  both.  It  seems 
probable  chat  simulator  training  under  conditions  of  turbulence  would 
increase  trainees'  ability  to  cope  with  turbulence  in  the  aircraft,  but 
it  is  by  no  means  certain  that  the  presence  of  disturbance  motion  cues 
would  enable  trainees  to  acquire  such  skills  more  quickly  or  to  acquire 
a  higher  level  of  such  skills  than  would  be  possible  with  visual  cues 
alone,  No  data  to  support  or  refute  this  hypothesis  have  been  located. 
An  empirical  test  of  this  hypothesis  will  require  the  measurement  of 
training  transfer  from  the  simulator  to  aircraft  flight  in  turbulent 
conditions.  Because  of  the  requirement  to  fly  Jn  turbulent  conditions, 
such  a  study  would  be  difficult  and  hazardous  to  perform. 


^ •  Does  the  presence  of  ancorrelated  disturbance  motion.  In  a 
rotary-wing  simuJator" increape  significantly  aviators'  ability  to  use 
aircraft  motion  as  an  alerting  cue?  Semple  et  .  aTT  (Il98ia)  report 
anecdotal  evidence  that  motion  cueing  may  be  necessary  for  (simulator 
training  on  tasks  and  conditions  that  require  aviators  to  maintain 
control  of  the  aircraft  while  performing  other  tasks.  The  thesis  is! 
when  the  aviator  is  attending  to  tasks  other  than  aircraft  control, 
motion  cues  alert  him  to  the  need  to  attend  to  the  control  function  and 
to  make  corrective  control  inputs.  This  alerting  function  of  motion  is 
presumed  to  be  especially  Importanr  when  aviators  must  maintain  aircraft 
control  while  performing  tasks  that  require  them  to  view  cockpit 
displays  and  controls.  It  is  conceivable  that  the  alerting  function  of 
motion  may  be  important  for  simulator  training  of  both  contact  and 
^^a^rument  flight, 

5.  Dots  training  In  a  simulator  equipped  with  a  motion  nystem 
increase  aviators'  ability  to  diagnose  and  respond  to  aircraft  failures 
and  malfunctions  that  are  signalled  by  unusual  ntrTrn'mc  motion?  Caro 
(  1979),  among  others,  has  BUggestod  tliat  a  slmul.nCor  capable  of 
generating  correlated  disturbance  motion  can  be  used  to  train  aviators 
to  correctly  diagnoao  and  respond  to  the  types  of  aircraft  failures  and 
malfunctions  that  are  signalled  by  sudden  airframe  movements,  tlie  onset 
of  airframe  vibration,  or  both.  The  underlying  .assumption  is  that 
aviators  trained  to  use  motion  cues  can  diagnose  failures  more 
accurately  and  can  initiate  appropriate  control  inputs  more  quickly  chan 
would  be  possible  with  visual  cues  aioni.. 

Although  the  potential  p.ayoff  of  training  on  emergency  maneuvers 
is  great,  it  will  be  difficult  to  make  an  objective  assessment  of  the 
benefits  of  such  training.  One  source  of  dirfic\ilty  stems  from  problems 
associated  measuring  training  transfer  Co  the  aircraft.  Tne 

measurement  of  training  transfer  requires  tliat  as'iators'  responses  to 
.selected  mal  funct  ion.s  be  mea.surod  In  the  .ilrcraft.  Here  lies  the 
problem.  Some  types  of  malfunctions  simply  c.innot  be  slmul.acod  In  the 
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aircraft  by  temporarily  disabling  an  aircraft  component;  other  malfunc¬ 
tions  can  be  simulated  in  the  aircraft  by  temporarily  disabling  an 
aircraft  component »  but  It  is  excessively  hazardous  to  do  so.  A  second 
source  of  difficulty  stems  from  problems  In  assessing  the  benefits  that 
result  from  effective  training  on  emergency  maneuvers.  Ultimately,  the 
only  benefits  that  result  from  such  training  are  reductions  in  the 
Incidence  and  consequences  of  accidents.  Because  accident  frequency  Is 
so  low,  several  years  would  be  required  to  accumulate  sufficient  acci¬ 
dent  data  to  assess  the  Impact  of  emergency  procedures  training  on 
accident  frequency  and  severity;  this  Is  true  even  If  the  training  on 
emergency  procedures  were  conducted  Armywide. 

6 .  Does  training  In  a  simulator  equipped  with  a  platform  motion 
system  effect  the  likelihood  that  aviators  will  become  disoriented 
during  contact  and/or  Instrument  flight  in  the  aircraft?  All  arguments 
that  favor  the  use  of  motion  systems  are  based  on  the  fundamental  belief 
that  aircraft  motion  conveys  Information  that  enables  experienced 
aviators  to  perform  better  on  some  tasks  than  would  be  possible  by 
attending  only  to  visual  cues.  In  a  word,  the  argument  is  that  motion 
In  the  simulator  teaches  aviators  to  better  use  motion  cues  In  the 
aircraft.  This  argument  seems  to  be  in  direct  conflict  with  the 
practice  of  teaching  all  Army  aviator  trainees  that  motion  cues  may  lead 
to  serious  spatial  disorientation  during  flight  (see  TC  1-20).  The 
Implication  of  this  training  Is  that  aviators  must  learn  to  disregard 
motion  cues,  especially  when  visual  cues  are  degraded  by  darkness  or 
atmospheric  attenuation.  Because  of  aviators'  susceptibility  to  motion 
Illusions  (leans,  Coriolis  illusions,  and  proprioceptive  illusions*^), 
one  cannot  discount  the  possibility  that  training  aviators  to  take  full 
advantage  of  the  information  conveyed  by  motion  cues  In  the  simulator 
may  increase  the  incidence  of  disorientation  in  flight.  On  the  other 
hand,  one  cannot  discount  the  possibility  that  simulators  designed  to 
teach  aviators  how  and  when  to  use  motion  cues  may  decrease  aviators' 
susceptibility  to  disorientation  induced  by  motion  Illusions. 

7 .  To  what  extent  can _ the  cues  provided  by  platform  motion  be 

produced  by  Force  cueing  devices?  This  question  is  relevant  only  If 
plntforni  n’otli>n  is  found  to  enhance  training  transfer  to  the  aircraft. 
Kicard  et  al.  found  Chat  skill  acquisition  in  the  aircraft  is 
enhanced  by  G-seat  motion,  but  not  to  the  extent  that  skill  acquisition 
is  enhanced  by  platform  motion.  Although  this  research  was  limited  to  a 
single  task — hoverlng--and  utilized  a  display  with  a  relatively  narrow 
f ield-of-view ,  the  findings  nevertheless  support  the  hypothesis  chat 
force  cueing  devices  convey  some  useful  information  to  the  aviator. 
Additional  research  is  needed  to  assess  the  relative  benefits  of 
platform  motion  and  force  cueing  for  a  wider  range  of  tasks  and  a  wider 
range  of  force  cueing  devices. 


'^See  TC  1-2(1  for  the  definition  of  leans,  Coriolis  illusions,  and 
proprioceptive  illusions. 


8 .  Is  simulator  sickness  Influenced  by  maneuver  motion,  distur¬ 
bance  motion,  or  both?  Heretofore,  it  has  been  assumed  that  simulator 
sickness  occurs  rare-ly  and  that  individuals  who  experience  simulator 
sickness  quickly  adapt  to  the  simulator.  The  results  of  recent  research 
indicate  that  motion  sickness  is  more  prevalent  and  more  severe  than  has 
previously  been  supposed.  Incidents  of  simulator  sickness  have  been 
reported  recently  in  fighter  aircraft  simulators  (McGulness,  Bouwtaan,  & 
Forbes,  1981),  patrol  aircraft  simulators  (Crosby  I  Kennedy,  1982),  and 
helicopter  simulators  (Frank  A  Crosby,  1982).  Moreover,  there  have  been 
reports  of  simulator  sickness  in  both  fixed-base  and  moving-base 
simulators  (Frank,  Kellogg,  Kennedy,  &  McCauley,  1983),  Symptoms  of 
motion  sickness  have  occurred  not  only  during  the  simulator  flight  but, 
in  some  cases,  have  lasted  several  hours  past  exposure.  Some  aircrews 
have  reported  the  onset  of  eympcomc  as  much  us  eight  hours  after 
terminating  the  simulator  flight  (Kellogg,  Castore,  A  Coward,  1980). 

Although  a  great  deal  Is  known  about  motion  sickness,  current 
knowledge  la  insufficient  to  predict  the  influence  of  platform  motion  on 
the  incidence  and  severity  of  simulator  motion.  Further  research  is 
required  to  determine  whether  the  presence  of  platform  motion  effects 
motion  sickness  and,  if  so,  to  determine  the  relationship  between  tha 
characteristics  of  motion  and  motion  sickness.  This  research  must 
address  maneuver  motion  and  disturbance  motion  separately  and  in 
combination. 


PROPOSED  RESEARCH  PLAN:  MOTION-SYSTEM  FIDELITY 

The  proposed  research  plan  is  illustrated  schematically  in  Figure 
4.  It  should  be  noted  that  the  research  plan  contains  three  decision 
points  at  which  the  findings  of  the  previous  research  tasks  dictate  what 
tasks  are  to  be  accomplished  subsequently.  Initially,  a  series  of 
studies  will  be  designed  and  conducted  to  assess  the  effect  of  motion  on 
skill  acquisition  in  the  simulatoi.  If  no  evidence  is  found  that  motion 
enhances  skill  acquisition  in  the  simulator,  the  research  will  be  termi¬ 
nated  and  a  recommendation  will  be  made  to  discontinue  the  procurement 
of  motion  systems  for  rotary-wing  simulators. 

The  second  decision  point  occurs  after  the  completion  of  a  series 
of  transf er-of-trainlng  studies.  If  Che  research  findings  show  that 
transf er-of-training  l^s_  enhanced  by  motion,  the  cost  effectiveness  of 
candidate  motion  systems  will  be  assessed;  otherwl.se,  the  research  will 
he  terminated  at  this  point  with  the  conclu.sion  Chat  luoticin  systems 
cannot  be  cost  effective. 

The  final  decision  point  occurs  after  cost-ef f ectivene.ss  analyses 
have  been  completed.  If  none  of  the  candidate  motion  .systems  prove  cost 
effective,  there  obviously  is  no  need  to  proceed  further.  However,  if 
the  cost-cf fccti veness  data  show  ojir  or  more  morion  systems  to  be  cost 
effective,  re.search  on  motion  sickness  will  lur  reviewed  (or  conducted, 
if  necessary)  and  design  requirements  for  the  most  co.st-ef  i  ective 
sy.stcm(s)  will  be  developed. 


The  research  was  designed  In  this  manner  to  avoid  the  high  coat  of 
conducting  transfer>of-tralnlng  research  If  there  Is  no  necessity  to  do 
so.  Obviously,  the  most  critical  assumption  underlying  this  research 
plan  Is  chat  a  lack  of  evidence  that  motion  enhances  skill  acquisition 
in  the  simulator  Is  sufficient  Justification  to  conclude  that  motion 
will  not  enhance  training  tiansfer  from  the  simulator  to  the  aircraft, 
Although  this  assumption  cannot  be  questioned  on  logical  grounds,  there 
Is  a  risk  that,  In  practice,  some  form  of  useful  learning  could  occur  In 
the  simulator  that  Is  not  reflected  In  the  performance  measures  Chat  are 
employed,  Every  attempt  muse  be  made  to  minimise  this  risk  through  the 
careful  consideration  and  selection  of  performance  measures  and, 
perhaps,  through  the  conduct  of  preliminary  research  to  validate  the  set 
of  performance  measures  Chat  are  adopted. 

Each  of  the  proposed  research  tasks  is  described  in  the  following 
paragraphs , 

Select  Sample  of  Motion  Systems 

Ideally,  the  In-slmulator  research  would  be  conducted  to  assess 
Che  benefits  of  both  platform  motion  systems  and  Che  full  range  of  force 
cueing  devices  Chat  might  replace  or  augment  platform  moclon  systems. 
Many  of  the  existing  force  cueing  devices  evolved  as  a  result  of 
attempts  to  simulate  G-force  cues  present  in  high  performance,  flxed- 
winic;  aircraft.  Examples  of  such  devices  Include  G-sults,  G>seaCs, 
helmet-loaders,  arm-loaders,  and  visual  grayouc/blackout  capabilities. 
Since  G-forces  exceeding  one-G  are  seldom  experienced  In  helicopters, 
the  use  of  force  cueing  devlcos  for  the  sole  purpose  of  G-forcii  cueing 
makes  little  sense  for  helicopter  simulation.  Of  the  force  cuclng 
devices  that  have  been  developed,  only  Che  seat  shaker,  the  G-seaC,  and 
the  sf-'^.k  sheker  promise  to  provide  cues  that  may  replace  or  augment  the 
cues  generated  by  a  platform  motion  system.  The  G-.aeat  is  the  only  one 
of  the  force  cueing  devices  that  is  capable  of  producing  cues  to  high 
amplitude,  low  frequency  motion;  so,  the  C-seat  is  the  only  force  cueing 
device  that  h.T^  aigniflcant  potential  for  replacing  platform  lantion 
cues.  Scich  shakers  and  scat  .■;l)akers  have  chn  potential  for  simulating 
cues  associated  with  low  amplitude  mot-on  resulting  from  airfra''..e 
vibration,  For  the  most  part,  these  high  frequency,  low  amplitude  cues 
are  beyond  the  capability  of  platform  motion  systems  and  G-seats — at 
least  as  tliey  are  presently  configured. 

Rased  upon  the  informuClon  in  hand,  it  appears  chat  the  in- 
slmulator  research  should  investigate  the  benefits  of  platform  motion 
and  at  least  three  force  cueing  devices:  G-seat ,  stick  shaker,  and  seat 
shaker . 
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Opclmlz«  Driving  Algorithms 

Non-'optlmal  algorithms  for  driving  the  motion  systems  investigated 
could  Invalidate  the  motion  system  research,  so  it  Is  essential  that 
effort  be  expended  at  '’he  outset  to  ensure  that  the  driving  algorithms 
are  as  effective  as  they  can  be  made.  Algorithms  must  be  evaluatad  In 
terms  of  (a)  the  delay  between  control  Inputs  and  the  onset  of  motion, 
(b)  the  synchronization  of  visual  and  motion  system  movements,  and  (c) 
the  extent  to  which  the  motion  generated  by  the  algorithm  elicits  the 
appropriate  perceptions  of  motion. 

Research  on  fixed-wing  aircraft  simulators  has  shown  that  exces¬ 
sive  delays  in  the  platform  motion  system  and  excessive  asychronization 
of  the  platform  motion  system  and  the  visual  system  may  degrade  perfor¬ 
mance  in  the  simulator  and  may  cause  disorientation  and  simulator 
sickness  (Ricard  &  Puig,  1977;  Pulg,  Harris,  &  Ricard,  1978).  However, 
considerable  uncertainty  exists  about  what  is  "excessive."  Ricard  and 
Pulg  (1977)  concluded  that  simulation  system  delays  (motion  and  visual) 
should  not  exceed  125  mllllaeconds,  but  Riley  and  Miller  (1978)  report 
that  delays  of  as  much  as  250  milliseconds  can  be  tolerated  In  some 
Instances.  Apparently,  these  differences  stem  wholly  or  In  part  from 
differences  in  the  flying'  tasks  investigated.  Semple  at  ^1.  (1981a) 
recommended  that  the  delay  between  visual  and  motion  cues  should  not 
exceed  50  milliseconds  for  highly  dynamic  maneuvering  and  150  milli¬ 
seconds  for  less  dynamic  maneuvering.  However,  this  recommendation  was 
aimed  specifically  at  fixed-wing  aircraft  maneuvering  and,  furthermore, 
was  based  upon  "informed  opinion"  rather  than  empirical  data. 

The  research  data  on  maximum  tolerable  motion  delays  and  maximum 
tolerable  vistval/motlon  asychronization  are  sketchy  and  the  generallz- 
abillty  of  the  data  to  helicopter  simulators  Is  questionable.  Moreover, 
it  Is  not  known  whether  the  conclusions  drawn  from  resuarch  on  platform 
motion  are  valid  for  force  cueing  devices.  Because  of  the  lack  of 
relevant  data,  it  may  be  necessary  to  conduct  preliminary  research  to 
ensure  that  the  shortest  delays  and  the  greatest  visual/motion  synchro¬ 
nization  obtainable  with  the  reaenrch  equipment  available  are  near 
optimal.  Stated  diffe'ently,  it  is  essential  tli.it  the  in-sir.ula  tor 
research  to  assess  skill  acquisition  on  various  tasks  not  be  invalidated 
by  a  motion  driving  algorithm  that  generates  excessively  long  lags  and 
excessive  visual/moCion  .isychronlzation. 

The  necessary  research  would  require  that  skill  acquisition  be 
measured  for  the  shortest  delay  achievable  and  for  several  progressively 
longer  delays.  It  could  oe  concluded  that  the  shortest  delay  achievable 
la  near  optimal  if  the  skill  acquisition  rate  reaches  an  asymptotic 
level  at  a  delay  longer  than  the  shortest  delay  achievable  with  the 
equipment.  For  Instance,  suppose  the  shortest  delay  achievable  is  50 
milliseconds  and  that  skill  acquisition  rate  is  Investigated  for  50 
milliseconds,  100  milliseconds,  150  mi  1 1 Iseconda ,  and  200  milliseconds. 
If  skill  acquisition  rate  Increases  as  delay  decreases  to  an  asymptotic 
level  at  100  milliseconds,  it  can  be  concluded  that  use  of  a  50  milli¬ 
second  delay  Is  t.ear  optimal  and  that  valid  research  on  motion  can  be 


conducced  with  an  algorithm  chat  generates  a  delay  of  50  milliseconds. 
Preliminary  research  should  be  conducted  to  assess  delays  (both  the 
delay  between  control  Input  and  motion  onset  and  the  delay  between 
visual  and  non-vlsual  motion)  for  platform  motion  and  each  force  cueing 
device  selected  for  study. 

No  empirical  research  has  been  located  chat  assesses  that  extent 
to  which  motion  driving  algorithms  developed  for  helicopter  simulators, 
in  fact,  generate  motions  that  elicit  the  appropriate  perceptions. 
Perceptions  are  appropriate  if  the  motion  enables  Che  Individual 
experiencing  the  simulator  motion  to  make  valid  Inferences  about  Che 
motion  of  Che  simulated  aircraft.  Heretofore,  algorithms  for  platform 
motion  have  been  "tweeked"  until  experienced  aviators  Judge  that  the 
"feel"  Is  about  right.  However,  anecdotal  evidence  from  experienced 
Army  aviators  Indicate  that  aviators  seldom  agree  on  what  "feels'*  about 
right.  No  easy  solution  to  this  problem  can  be  offered  at  thlti  time. 
Research  to  optimise  driving  algorithms  with  respect  Co  Che  perceptions 
they  generate  probably  will  Involve  both  engineering  and  psychophysical 
studies.  Engineering  studies  are  required  to  ensure  that  Che  delving 
algorithm  Is  producing  the  desired  amplitudes,  accelerations,  and 
frequencies.  Psychophysical  studies  are  required  to  ensure  that  the 
physical  motion  Is  generating  the  appropriate  perceptions. 


Select  Sample  of  Training  Tasks 

As  shown  In  Figure  A,  the  selection  of  training  tasks  must  be 
accomplished  concurrently  with  the  design  of  specific  in-simulator 
studies.  The  objective  Is  to  select  a  sample  of  training  tasks  that, 
together,  cover  (a)  the  full  range  of  tasks  for  which  training  may  be 
facilitated  by  Che  presence  of  motion  cues,  and  (b)  Che  full  range  of 
motion  types  encountered  In  helicopters. 


Develop  Instructional  Methods 

Ineffective  instructional  methods  can  enslly  mask  cho  effects  of 
any  Independent  variable  investigated  in.  a  skil]  acquisition  study,  As 
a  consequence,  It  Is  essential  that  Instructional  methods  he  developed, 
pretested,  and  refined  prior  to  the  initiation  of  the  In-simulator 
research.  Specific  Instructional  procedures  for  each  training  task 
Investigated  must  be  developed  for  both  the  experimental  group(s)  and 
control  groupCs). 


Dcslgn/ConducC  In-Slmulator  Studies 

Skill  acquisition  is  the  main  dependent  variable  for  all  of  the 
in-almulator  research.  Both  skill  acquisition  rate  and  asymptotic  skill 
level  are  of  interest.  Incidences  of  aviator  disorientation  and  slmu- 


assess  the  effects  of  motion  on  aviator  disorientation  and  simulator 
sickness  is  considered  beyond  the  scope  of  the  prasent  study.  The 
Independent  variables  that  must  be  Investigated  Include  but  are  not 
necessarily  limited  to  the  following: 

e  type  of  motion  (maneuver  motion,  correlated  disturbance  motion, 
and  uncorrelated  disturbance  motion) , 

e  motion-generation  method  (platform  motion,  (i-seat,  seat  shaker, 
stick  shaker), 

a  aircraft  stability  (varied  by  selecting  taaV;s  for  which  aircraft 
stability  differs) , 

a  stability  augmentation  (varied  by  systematically  disabling 
parameteis  of  the  stability  augmentation  system), 

a  stage  of  skill  acquisition  at  which  motion  cues  are  first 
introduced , 

a  aviator  taak-loadlng/tlme-sharlng  requirements,  and 

e  type  of  aircraft  malfunction. 

Motion  is  the  primary  indepandent  variable;  the  other  independent 
variables  listed  abovs  are  secondary  in  the  sense  that  they  are 
variables  that  may  Influence  the  magnitude  of  motion's  effect  on  skill 
acquisition. 

It  will  not  be  possible  to  formulate  specific  experimental  designs 
until  final  decisions  are  made  about  tha  hypotheses  to  be  tested.  The 
hypotheses  discussed  in  the  introduction  of  this  subsectiorr  are 
illustrative  but  should  not  be  considered  comprehensive.  Although 
experimental  designs  cannot  be  specified  at  this  time,  tha  development 
of  suitable  designs  for  this  research  is  not  viewed  as  a  difficult  task. 
The  main  consideration  In  formulating  experimental  designs  Is  to  ensure 
that  the  design  Includes  a  (no-motion)  control  group  against  which 
performance  of  each  experimental  group  can  be  compared. 

It  is  expected  that  several  pilot  studies  will  be  required  to 
(lovolop  suitable  procedures  Cor  this  research.  In  principal,  the 
general  procedure  is  simple  and  straightforward:  train  all  members  of 
the  experimental  (motion)  groups  and  control  (no-motion)  group(8)  to  an 
asymptotic  level  on  selected  flying  tasks.  One  problem  in  implementing 
this  procedure  is  that  of  defining  when  performance  reaches  an 
.asymptotic  level.  Although  this  problem  is  by  no  means  unusual, 
preliminary  research  will  be  necessary  to  get  a  general  idea  of  the  rate 
at  which  skll]  on  each  task  is  acquired  and  to  develop  specific  criteria 
Cor  Judging  when  performance  on  successive  practice  trials  has  become 
sufficiently  stable  to  be  considered  asymptotic. 

A  second  procedural  problem  in  that  of  ensuring  that  subjects  have 
tliu  prerequisite  skills  needed  to  learn  a  given  flying  task  effectively. 
Subjects  with  no  prior  flying  experience  whatsoever  would  make  little 
progress  in  learning  a  difficult  t.nsk  such  as  an  autorotatlon .  It  Is 


certain  that  some  amount  of  preliminary  training  will  be  necessary  to 
accurately  assess  the  effect  of  motion  on  the  learning  of  the  more 
difficult  flying  tasks.  One  solution  to  this  problem,  and  possibly  the 
best  one,  is  to  develop  a  comprehensive  program  of  instruction  that 

commences  with  the  easiest  flying  tusks  and  progresses  to  the  more 
difficult  tasks,  training  each  cask  to  an  asymptotic  level  before 

proceeding  to  the  next  cask.  Assessing  the  effects  of  motion  on 
essentially  all  the  tasks  chat  can  be  trained  in  Che  simulator  would  be 
time-consuming,  but  would  provide  Che  data  needed  to  assess  both  (a)  the 
effects  of  motion  on  individual  Casks  and  (b)  the  accumulated  effects  of 
motion  throughout  the  program  of  Instruction. 

The  third  important  procedural  problem  is  that  of  defining 

effective  performance  measures  for  each  flying  task  investigated, 
Obviously,  It  is  essential  Chat  the  performance  measures  provide  a 
reliable  and  a  sensitive  index  of  the  rate  and  level  of  skill 

acquisition.  A  less  obvious  requirement  is  for  performance  measures 
chat  have  value  in  dlagnoalng  differences  in  skill  acquisition. 


Decision  Point  One 

Once  Che  in-simulator  research  has  been  completed,  it  will  be 
necessary  to  decide  whether  further  research  should  be  conducted. 
Specifically,  Che  composite  findings  of  the  in-simulator  research  must 
be  assessed  Co  determine  whether  Che  beneficial  effect  of  motion  on 
skill  acquisition  is  sufficiently  large  to  justify  Che  design  and 
conduct  of  transfer-of-training  research.  Such  an  assessment  must  be 
made  for  Che  platform  motion  system,  each  of  the  four  cueing  devices, 
and  each  combination  of  motion-generation  devices  that  is  investigated, 

A  decision  to  terminate  Che  research  at  this  point  will  be  a 
simple  matter  if  no  evidence  la  found  Chat  motion  enhances  skill 
acquisition  In  the  simulator  or,  conversely,  the  evidence  Indicates  that 
motion  benefits  In-slraulator  skill  acquisition  significantly  and 
uniformly — across  tasks  and  motion-generation  devices.  The  decision 
will  be  a  difficult  one  to  make  in  the  more  likely  event  that  the 
findings  are  mixed;  motion  from  some  of  the  mot ion-genovatlon  devices 
is  found  to  benefit  skill  acquisition  on  some  flying  tasks,  In  the 
event  of  mixed  findings,  there  is  no  alternative  to  the  use  of  Informed 
judgment  in  deciding  whether  or  not  to  proceed  with  the  transfer-of- 
Cralning  research.  It  is  recommended  that  the  decision  to  continue  or 
terminate  the  research  on  motion  at  this  point  be  made  by  a  team 
composed  of  a  multi-disciplinary  team  of  subject  matter  experts  after  a 
comprehensive  review  end  discussion  of  the  research  findings. 


Design/Conduct  Transfer-of-Training  Research 


The  objective  of  the  transfer-of-training  ri’Re.nrch  Is  not  merely 
tn  determine  whether  the  benefits  of  simulator  motion  transfer  to  the 


alrcrafc.  Racheri  the  objective  is  to  collect  the  data  needed  to 
determine  whether  the  Increase  In  training  transfer  attributable  to 
simulator  motion  Is  great  enough  to  offset  the  cost  of  providing  motion 
cues  during  simulator  training.  A  separate  transfer-of-tralnlng  study 
must  be  conducted  for  each  motion-generation  device)  or  combination  of 
devices,  found  to  enhance  In-slmulator  training  to  a  significant  degree, 

A  fully  comprehensive  cost-effectiveness  assessment  of  motion- 
generation  devices  requires  that  transfer-of-tralnlng  be  measured  for 
lERW  training)  transition  training,  and  continuation  training.  Although 
all  lERW  training  la  presently  conducted  In  an  aircraft,  plans  have  been 
made  to  conduct  research  to  determine  the  amount  of  lERW  training  that 
can  be  accomplished  In  a  flight  simulator.  If  simulator  training  proves 
to  be  effective,  the  transfer-of-tralnlng  studies  proposed  here 
definitely  should  Include  lERW  training;  otherwise,  the  studies  should 
be  limited  to  transition  and  continuation  training.  Because  of  the 
difficulties  associated  with  assessing  the  effectiveness  of  continuation 
'4  training.  It  is  recommended  that  studies  first  be  performed  to  assess 

'  the  extent  to  which  motion  benefits  the  simulator  training  of  lERW  and 

transition-training  tasks.  It  is  possible  that  the  results  of  these 

atudlee  will  be  adequate  to  make  a  decision  concerning  the  cost 
effectiveness  of  some  or  all  of  the  motion-generation  devices  for  use  in 
continuation  training. 

The  traditional  paradigm  for  measuring  the  transfer  of  simulator 
training  consists  of  (a)  training  a  control  group  to  criterion 
exclusively  In  the  aircraft,  and  (b)  training  an  experimental  group 
I  first  in  the  simulator  anu  then  to  criterion  in  the  aircraft.  The 

paradigm  appropriate  for  measuring  the  effect  of  motion  on  the  transfer 
of  simulator  training  differs  from  the  traditional  paradigm  only  in 
terms  of  the  control  group;  the  control  group  receives  simulator 
training  with  no  motion  and  then  Is  trained  to  criterion  In  the 
aircraft.  The  use  of  a  control  group  trained  to  criterion  exclusively 
I  in  Che  aircraft  is  considered  essential  only  if  the  effectiveness  of  the 

simulator  training  has  not  been  validated, 

A  key  issue  in  designing  the  transfer-of-training  studies  is  Che 
selection  of  the  casks  chat  are  to  be  trained  In  Che  simulator.  The 
tasks  of  interest  are  the  ones  for  which  skill  acquisition  was  enhanced 
by  Che  presence  of  motion.  However,  because  of  the  Interdependencies 
among  flying  tasks,  It  Is  unlikely  chat  the  simulator  training  can  be 
limited  to  tasks  Chat  are  found  to  benefit  from  simulator  motion.  As 
was  stated  earlier,  effective  training  on  some  flying  tasks  is  not 
possible  until  Che  trainee  has  acquired  certain  prerequisite  skills.  As 
a  consequence,  the  simulator  training  must  include  both  the  tasks  that 
are  known  to  benefit  from  the  presence  of  motion  and  tasks  that  enable 
subjects  to  acquire  prerequisite  skills.  Preliminary  research 
definitely  will  be  required  to  identify  prerequisite  skills  and  the 
tasks  that  must  be  trained  in  the  simulator  Co  ensure  that  the  subjects 
possess  the  prerequisite  skUIs. 
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The  design  of  research  to  assess  the  extent  to  which  motion 
Increases  the  utility  of  flight  simulators  for  accomplishing  continua¬ 
tion  training  Is  complicated  by  the  lack  of  data  on  skill  decay.  The 
benefits  of  using  a  flight  simulator  for  continuation  training  cannot  be 
measured  unless  the  relevant  flying  skills  are  permitted  to  decay.  And 
y«t,  no  data  are  available  to  use  in  estimating  performance  degradation 
on  various  flying  tasks  as  a  function  of  variables  such  as  aviator 
experience  (total  flying  hours)  and  the  amount  of  flying  an  aviator  has 
exporlenced  since  his  last  successful  proficiency  chcckrlde.  Until  such 
data  are  available.  It  will  not  be  possible  to  design  efficient  and 
meaningful  research  to  determine  the  impact  of  motion  on  continuation 
training  and  flight  simulators. 

A  final  important  research  design  issue  concerns  the  assessment  of 
motion's  effect  on  the  simulator  training  of  responses  to  certain 
aircraft  malfunctions.  Responses  to  some  malfunctions  cannot  be 
practiced  or  assessed  In  the  aircraft — either  because  the  malfunction 
cannot  be  simulated  in  the  aircraft  or  because  It  Is  too  dangerous  to  do 
so.  Obviously,  it  Is  not  possible  to  measure  training  transfer  from  the 
simulator  to  the  aircraft  If  it  is  not  possible  to  measure  performance 
in  the  aircraft.  No  solution  to  this  problem  Is  apparent  at  this  time. 


Decision  Point  Two 

If  the  research  findings  indicate  that  training  transfer  Is 
increased  by  a  motion-generation  device,  a  decision  will  be  made  to 
proceed  with  a  detailed  analysis  to  assess  the  cost  effectiveness  of 
that  device.  It  will  be  recommended  that  Che  Army  discontinue 
procurement/use  of  motion-generation  devices  found  to  have  a  negligible 
effect  on  training  transfer. 


Assess  Cost  Effectiveness  of  Candidate  Motion-Generation  Devices 

The  objective  of  this  task  is  to  determine  if  the  savings  in 
training  costs  ruiil  Ined  from  the  use  of  motion  during  simulator  training 
is  great  enough  to  offset  the  life-cycle  costs  of  the  motion-generation 
device.  Training-cost  savings  will  be  estimated  for  each  motion- 
generation  device  that  is  found  to  enhance  training  transfer.  In 
concept,  calculating  the  training-cost  savings  attrlbutohle  to  motion  is 
accomplished  merely  by  subtracting  the  total  costs  of  training  with 
motion  from  the  total  costs  of  training  without  motion.  To  estimate 
total  training  costs,  it  is  necessary  to  compile  accurate  direct  and 
indirect  cost  data  for  both  the  simulator  and  the  aircraft  training. 

The  methods  for  calculating  training  costs  are  discussed  in  detail 
elsewhere  (DOD,  1973;  Orlanskl  S  String,  1977;  Marcus  et  al.,  1980; 
M-ayer,  1981).  However,  one  problem  that  is  unique  to  this  rese.irch  mus  . 
be  acknowledged.  There  are  certain  indirect  costs  associated  with 
platform  motion  that  are  difficult  to  estimate.  It  Is  difficult  to 


estimate  the  added  cost  of  producing  visual  systems  that  are  compact 
enough  to  be  mounted  on  a  motion  platform  and  yet  rugged  enough  to 
tolerate  the  physical  stress  of  movement  in  six  degrees  of  freedom.  It 
also  Is  difficult  to  estimate  the  added  costs  of  bulldingi  heating/ 
cooling,  and  maintaining  a  structure  that  la  much  larger  than  would  be 
required  to  house  a  simulator  without  a  platform  motion  system. 
Clearly,  careful  study  will  be  required  to  derive  accurate  estimates  of 
such  costs. 


Decision  Point  Three 

The  effort  will  be  terminated  at  this  point  If  the  cost- 
effectiveness  analysis  shows  that  negligible  training-cost  savings  are 
realized  from  the  use  of  motion  during  simulator  training. 


Formulate  Recommandations 

If  the  training-cost  savings  are  of  practical  Importance,  it  will 
be  recommended  that  the  coat-affective  motion  devlceCs)  be  employed  on 
present  and  future  helicopter  simulators.  The  composite  research 
findings  will  be  used  to  formulate  functional  design  requirements  for 
the  motion-generation  daviceCs)  recommended  for  use. 

HANDLING-QUALITIES  FIDELITY  REQUIREMENTS 

Handling-qualities  fidelity  is  the  extent  to  which  the  simulated 
aircraft  responds  to  control  inputs  snd  environmental  forces  in  the  seme 
manner  as  the  aircraft  being  simulated.  Ultimately,  handling  qualities 
must  be  defined  in  behavioral  rather  than  engineering  terms.  Measurable 
differences  between  the  handling  qualities  of  the  simulator  and  the 
aircraft  are  significant  only  to  the  extant  that  they  Influence  user 
acceptance  and  training  effectiveness.  Differences  that  are 
d Iscr imlnable  by  experienced  aviators  may  influence  user  acceptance  but 
may  or  may  not  Influence  training  ef f ec t J voneas .  Conversely,  it  Is 
conceivable  that  differences  chat  cannot  consciously  be  discriminated  by 
experienced  aviators  could  adversely  affect  training  ef f uctiveness . 
Hence,  dlscrlminabillty  of  differences  Is  import.int  to  the  extent  that 
user  acceptance  is  affected.  Otherwise,  training  effectiveness  Is  the 
main  criterion  that  must  be  considered  in  establishing  requirements  for 
handling-qualities  fidelity. 

The  fidelity  of  a  simulator's  handling  qualities  is  determined  by 
the  characteristics  of  three  math  models:  the  control  system  model,  the 
environment  model,  and  the  aerodynamic  model.  A  great  deal  of  time  and 
resources  have  been  expended  by  the  Army  and  Army  contractors  in 
attempts  to  increase  the  validity  and  efficiency  of  the  models  used  for 
rotorcraft  simulation.  Much  of  this  work,  however,  has  been  motivated 
by  the  need  to  develop  effective  design  simulators  rather  than  the  need 


to  develop  effective  training  simulators.  It  Is  probable  chat  the 
highly  sophisticated  models  developed  to  aid  in  the  design  of  advanced 
rotorcrafC  may  be  far  more  complex  than  are  needed  for  training 
simulators  (R,  K.  Heffley,  Kanudyne  Systems,  Inc.,  personal 
communication,  1985). 

Consideration  of  the  state  of  knowledge  on  handling-qualities 
fidelity  has  led  to  Che  conclusion  that  two  related  lines  of  research 
are  required.  The  objective  of  one  line  of  research — principally  but 
not  exclusively  behavioral  research — is  to  compile  data  with  which  to 
plot  the  relationship  between  handling-qualities  fidelity  level  and 
training  effectiveness.  The  objective  of  the  second  line  of  research — 
principally  engineering  research— is  to  develop  more  cost-effective  ways 
to  achieve  adequate  levels  of  handling-qualities  fidelity.  The  second 
line  of  research  must  address  the  design  of  Che  math  models  used  in 
training  simulators  and  the  hardware  and  software  used  Co  implement  Che 
math  models.  Given  the  rapid  growth  in  related  technology,  it  is  highly 
probable  Chat  new  techniques  and/or  equipment  could  effect  a  drastic 
reduction  in  the  coat  of  producing  a  high  level  of  handling-qualities 
fidelity.  Cost  reduction,  in  turn,  has  an  important  influence  on  the 
level  of  handllng-qualltias  fidelity  chat  is  most  cost  effective. 

The  remainder  of  this  subsection  focuses  on  the  first  line  of 
research  mentioned  above.  There  are  two  main  issues  Chat  must  be  dealt 
with  before  it  will  be  possible  Co  develop  a  detailed  design  of  research 
to  define  handling-qualities  fidelity  requirements.  These  issues  are 
discussed  below. 


QUANTIFYING  LEVEL  OF  HANDLING-QUALITIES  FIDELITY 

In  order  to  define  the  optimal  level  of  fidelity  for  any 
simulator-design  parameter,  it  is  necessary  Co  measure  training 
effectiveness  as  the  fidelity  of  the  parameter  is  varied  systematically 
from  some  relatively  low  level  to  some  relatively  high  level.  At 
present,  a  study  of  handling  qualities  is  complicated  by  the  fact  that 
there  are  no  acceptable  methods  for  quantifying  the  similarity  between 
the  ..andling  qualities  of  the  simulator  and  the  handling  qualities  of 
the  simulated  aircraft.  Previous  attempts  to  use  experienced  aviators 
to  subjectively  assess  the  handling  qualities  of  simulators  have  not 
proved  highly  successful. 

Efforts  are  being  made  to  decrease  the  subjectivity  of  handling- 
qualities  assessment  by  using  more  flight-test  data  and  by  using 
specially  trained  engineering  test  pilots  (Woomer  &  Carico,  1977). 
However,  the  value  of  even  specially  trained  engineering  test  pilots  for 
quantifying  handling-qualities  fidelity  must  be  considered  questionable 
because  of  the  rapidity  with  which  aviators  accommodate  to  the  handling 
qualities  of  a  partlcul.nr  simulator.  In  this  regard,  Semple  and  his 
colleagues  state: 


Evidence  has  been  cited...  that  pilots  will  accoounodate  to 
air  training  device  cues  and  responses  after  as  short  a 
period  In  the  air  training  device  as  30  minutes  (Eddowcs, 

1977;  Harris.  1977;  Woomer  &  Cacico.  1977;  and  Rust.  1975). 

Beyond  this  time,  even...  evaluation  by  specially  trained 
acceptance  test  pilots  can  be  inaccurate  (Semple  et  al.. 

1981a,  p.  108). 

The  best  way  to  proceed  In  resolving  this  Important  problem  Is  not 
apparent  at  this  time.  Two  divergent  approaches  should  be  Investigated. 
One  approach  would  begin  with  an  analytical  study  to  define  the 
behavioral  dimensions  of  handling  qualities.  That  Is,  given  a  known 
control  Input  or  environmental  disturbance,  what  is  it  that  the  aviator 
perceives  chat  differentiates  the  handling  qualities  of  one  aircraft 
from  the  handling  qualities  of  another?  Once  the  fundamental  dimensions 
have  been  hypothesized,  it  would  be  necessary  to  develop  math  models 
Chat  would  enable  Che  researcher  to  vary  Che  value  of  each  dimension  In 
a  systematic  way,  and  to  conduct  studies  Co  "scale"  each  dimension.  A 
multidimensional  scaling  technique  probably  would  be  moat  appropriate 
for  this  purpose, 

A  second  approach,  quite  different  from  the  first,  Is  to 
operationally  define  handling-qualities  fidelity  In  terms  of  Che 
characteristics  of  Che  math  models  used  to  drive  the  flight  simulator. 
The  most  relevant  characteristics  are  Chose  that  have  the  most  signifi¬ 
cant  influence  on  the  cost  of  Implementing  the  math  models.  The  concept 
of  this  approach  Is  to  commence  with  a  very  simple  model  and  to  assess 
the  Impact  on  handling  qualities  as  the  complexity  of  the  model  is 
systematically  Increased.  The  feasibility  of  this  approach  Is  dependent 
on  Che  development  of  an  effective  way  to  measure  the  similarity  between 
the  handling  qualities  of  the  simulator  and  the  aircraft  as  the  models' 
characteristics  are  varied.  As  has  been  stated  above,  the  use  of 
subjective  judgments  of  aviators  for  this  purpose  is  not  promising. 
Hence,  the  use  of  this  approach  is  probably  contingent  on  the  develop¬ 
ment  of  an  objective  method  for  measuring  both  the  simulator's  and  the 
nircr.'ift's  response  to  known  control  inputs  and  environmental  distur¬ 
bances.  Assuming  this  goal  can  be  achieved,  the  interim  product  would 
bo  a  set  of  data  that  quantify  the  relationship  between  math  model 
complexity  and  measured  differences  in  handling  qualities.  Behavioral 
research  then  would  be  required  to  determine  the  relationship  between 
training  effectiveness  and  the  measured  differences  in  the  handling 
qualities  of  the  simulator  and  aircraft. 


VARIABLE  HANDLING-QUALITIES  FIDELITY  REQUIREMENTS 

Rese.arch  to  define  the  most  cost-effective  level  of  handling- 
qualities  fidelity  is  complicated  greatly  by  the  high  likelihood  th.it 
tho  minimum  acceptable  fidelity  level  differs  for  different  training 
applications.  Based  on  n  thorough  review  of  the  literature  and  informa¬ 
tion  gained  from  visits  to  simulator  training  facilities,  Semplu  sets 
forth  the  supposition  tlwit: 
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The  requirement  for  (handling-qualities)  fidelity  la 
diminished  for  trained  tasks  which  ace  in  the  middle  of  the 
performance  envelope  of  the  pilot  and  aircraft  system.  As 
the  trained  tasks  increase  In  difficulty  and  approach  the 
performance  limits  of  the  pilot  and  aircraft  combination » 
the  requirement  for  high  levels  of  (handling-qualities) 
fidelity  increased  accordingly  (Semple  et  al.|  L98Ia,  p, 

116). 

If  Semple's  supposition  is  correct,  it  follows  that  there  is  no 
single  level  uf  handling-qualities  fidelity  that  is  ideal  for  training 
all  tasks  and  all  aviators.  Furthermore,  it  follows  that  handling- 
qualities  fidelity  requirements  vary  as  a  function  of  the  proficiency 
level  desired  on  the  first  aircraft  following  simulator  training 
(first-flight  proficiency  level).  Semple's  rationale  clearly  is 
sufficiently  compelling  to  Justify  further  research  on  this  potentially 
important  issue.  Specifically,  aviator  skill  level,  task  difficulty, 
and  "first-flight"  proficiency  level  should  be  treated  as  Independent 
variables  in  the  research  to  define  handling-qualities  fidelity 
requirements.  Specific  research  questions  include  but  are  necessarily 
limited  to  those  discussed  below. 

e  To  what  extent  do  handling-qualities  fidelity  requirements  vary 
as  a  function  of  stage  of  training? 

e  At  each  stage  of  training,  to  what  extent  can  low  levels  of 
handling-qualities  fidelity  be  compensated  for  by  experienced 
instructor  pilots? 

e  Does  a  high  level  of  handling-qualities  fidelity  inhibit 
learning  in  the  beginning  student? 

•  To  what  extent  do  handling-qualities  fidelity  cequlrementa 
differ  for  skill  acquisition  training  and  skill  sustainment 
training? 

•  Given  that  han'Ling-qualltios  fidelity  requirements  vary  as  a 
function  of  task  difficulty,  is  it  cost  effective  to  establish 
handling  qualities  for  th<’  worst  case  condition,  i.e.,  the  most 
difficult  task  and  tiie  li'.a.u  skilled  aviator  encountered  at  the 
training  stage  for  whlcli  die  simulator  is  to  be  used? 

•  If  handling-qualities  fidelity  requirements  differ  for  different 

training  stages.  Is  it  technically  feasible  and  cost  effective  “ 

to  make  handling  qualities  e.asily  adjustable  so  that  the  same 
simulator  can  be  used  to  train  students  at  different  stages  of 
training?  If  handling  qualities  were  changed  in  different 
training  stages,  what  would  be  the  effect  on  training  transfer 

as  students  transition  from  one  training  stage  to  another? 

•  Given  that  hondllng-quallcics  fidelity  requivementa  vary  as  a 
function  of  "flrst~f light"  proficiency  level  denlred,  what  level 
of  fidelity  is  required  to  achieve  near  perfect  first-flight 
execution  of  tasks  that  .are  dangerous  to  practice  in  the 
aircraft,  e.g.,  emergenev  touchdown  procedures,  pinnacle 
landings  under  heavy  wind  conditions? 


•  Can  handling-qualities  fidelity  requirements  be  accurately 
predicted  from  a  study  of  the  consideration  of  the  skill 
components  of  a  cask,  -e.g,,  procedural  vs.  psychomotor, 
ballistic  vs.  continuous-adjustment  control  inputs? 


FIDELITY  REQUIREMENTS  FOR  COCKPIT  DISPUYS /CONTROLS 

With  few  exceptions,  the  external  appearance  of  the  displays  and 
controls  in  contemporary  Army  flight  simulators  is  Che  same  as  chose 
found  in  the  aircraft.  Typically,  off-the-shelf  displays  and  controls 
used  In  the  aircraft  itself  are  purchased  and  modified  as  necessary  by 
the  simulator  manufacturer.  The  modifications  required  to  adapt  the 
off-the-shelf  Instruments  for  simulator  use  are  often  major  and, 
therefore,  costly.  Some  off-the-shelf  displays,  for  instance,  require 
altogether  new  Internal  drive  mechanisms.  Simulator  manufacturers  are 
also  careful  to  reproduce  realistic  display  and  control  reaponse 
characteristics  (e.g.,  altimeter  response  lag  and  cyclic  control 
loading)  and  to  configure  the  simulator  displays  and  controls  in  the 
same  way  that  they  are  configured  in  the  aircraft.  In  short,  the  Army's 
flight  simulator  cockpits  have  a  vary  high  level  of  fidelity. 

There  has  been  no  systematic  research  conducted  to  define 
alternaclve.s  to  the  high-fidelity  cockpit  instruments  found  in  most 
military  flight  simulators  or  to  assess  the  training  effectiveness  of 
lower  fidelity  alternatives.  Such  research  is  clearly  needed. 

A  study  of  fidelity  requirements  for  cockpit  displays  and  controls 
should  commence  with  a  technology  survey  to  identify  the  full  range  of 
alternatives  to  the  displays  and  controls  presently  being  used. 
Certainly,  consideration  should  be  given  to  the  utility  of  dynamic, 
computer-generated  Images  of  conventional  dials,  gauges,  and  status 
displays.  Consideration  should  also  be  given  to  the  utility  of 
touch-sensitive  panels  as  replacements  for  conventional  switches, 
thumbwheels,  and  knobs.  Once  the  alternatives  have  been  Identified,  a 
prc]  imin<3ry  ccft  analysis  should  be  conducted  to  Identify  the 
alternatives  tht t  promise  to  he  less  costly  than  the  conventional 
display/cont ro  1  that  would  be  replaced.  Further  effort  would  be 
justified  only  If  the  cost  of  one  or  more  of  the  alternatives  is  found 
to  be  clearly  less  than  the  cost  of  the  conventional  counterp.art . 

If  less  costly  alternatives  are  found,  as  Is  almost  certain  to  be 
the  case,  the  next  step  would  be  the  conduct  of  empirical  research  to 
assess  the  training  effectiveness  of  each  alternative.  If  the  training 
effectiveness  of  the  alternative (s)  is  found  to  equal  or  exceed  Chat  for 
its  conventional  counterpart,  the  issue  Is  resolved:  Ir.  must  be 
concluded  that  the  alternative  Is  more  cost  effective.  However,  If  both 
the  cost  and  the  training  effectiveness  of  the  alternative  Is  less,  a 
cost-ef fcctl venoss  analysis  would  be  required  to  determine  whether  the 
cost  savings  are  large  enough  to  offset  the  loss  In  training  effective¬ 
ness.  Although  difficult  to  quantify,  user  acceptance  should  not  ho 


ignored  in  drawing  final  concluslona  about  the  suitability  of 
alternative  displays/controls. 

It  would  be  premature  to  propose  a  research  design  to  assess 
fidelity  requirements  for  simulator  displays/controls  until  alternatives 
have  been  identified  and  their  cost  estimated.  However,  it  seems 
unlikely  that  the  research  would  be  particularly  difficult  to  design. 


REQUIREMENTS  FOR  INSTRUCTIONAL  SUPPORT  FEATURES 

Hughes  (1979)  defines  ISFs  as  simulator  hardware  and  software  that 
allow  the  Instructor/operator  to  manipulate,  supplement  and  otherwise 
control  the  learning  experience  of  the  student  to  maximize  the  rate  and 
level  of  skill  acquisition.  Examples  of  ISFs  available  on  existing  Army 
helicopter  simulators  include  Problem  Freeze,  Record  and  Playback, 
Automated  Checkrlde,  Instructor/Operator  Console  Displays,  and  Automated 
Performance  Measurement.  Although  all  simulators  in  the  SFTS  are 
equipped  with  soma  combination  of  ISFs,  little  is  presently  known  about 
how  ISFs  should  be  used  or  the  extent  to  which  properly  used  ISFs 
increase  training  effectiveness.  The  research  described  in  this  sub¬ 
section  of  the  research  plan  has  been  designed  to  resolve  uncertaintlas 
about  the  proper  use  and  training  effectiveness  of  ISFs.  Specifically, 
the  objectives  are: 

e  to  define  potentially  effective  ISFs, 

e  to  define  the  optimal  use  of  potentially  effective  ISFs,  and 

e  to  assess  empirically  the  cost  effectiveness  of  ISFs,  individ¬ 
ually  and  collectively. 


INTRODUCTORY  COMMENTS 

The  following  paragraphs  briefly  describe  several  observations  and 
conclusions,  drawn  from  a  review  of  the  literature  on  ISF  design  and 
use,  that  have,  had  an  important  impact  on  the  proposed  research, 

ISF  Contribution  to  Simulator  Cost  and  Training  Effectiveness 
<1 

Empirical  evaluation  of  the  utility  of  ISFs  has  not  been  conducted 
to  provide  input  into  the  concept  development  and  design  phases  of  the 
simulator  hardware  and  software  acquisition  process,  Rather,  it  appears 
that  ISFs  have  been  Incorporated  into  existing  flight  simulators  based 
solely  on  logical  and  analytical  consideration  of  their  potential 
utility. 

The  Coat  and  Training  Effectiveness  Analynes  (CTEAf!)  that  art* 
conducted  on  new  flight  simulators  are  designed  to  ciotermine  the 
training  effectiveness  of  the  simulator  relative  to  the  tr.nlnlng  effec¬ 
tiveness  of  the  target  aircraft.  The  statistical  and  methodological 
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teciulrements  of  the  CTEA  are  such  that  aircraft  training  and  simulator 
training  are  conducted  In  as  similar  a  fashion  as  possible.  Thus,  the 
CTEA  process  Is  not  designed  to  yield  Information  about  the  cost  and 
training  ef f ecriveness  of  particular  ISFs  or  about  their  applications. 
Moreover,  the  Operational  Tests  I  and  It  conducted  by  the  Army  have 
provided  no  information  about  ISF'a  contribution  to  the  overall  cost  and 
training  affectiveness  of  the  device. 

ISF  Training  Effectiveness 

Only  a  few  experimental  studies  have  been  conducted  to  assess  the 
training  effectiveness  of  ISFs.  All  the  studies  located  during  the 
literature  review  were  conducted  either  by  the  Air  Force  Human  Raaoutces 
Laboratory  (AFHRL)  or  the  Naval  Training  Equipment  Center  (NTEC) .  The 
AFHKL  research  has  been  conducted  with  the  Air  Force's  Advanced 
Simulator  for  Pilot  Training  (ASPT) .  The  MTEC  research  has  bean 
conducted  with  the  Navy's  Visual  Technology  Research  Simulator  (VTRS) • 
Both  of  thase  flight  simulators  are  for  fixed-wing  aircraft,  which  hava 
very  different  missions  than  those  of  the  Army's  rotary-wing  cargo, 
utility,  obsarvatlon,  and  attack  aircraft.  Th«  ganarallty  of  findings 
from  the  studies  discussed  below  to  ISF  use  on  the  Army's  SFTS  la  not 
now  known. 

Hughes,  Hannan,  and  Jones  (1979)  compared  the  benefits  of 
instructional  use  of  the  Automated  Demonatration  ISF  and  the  Record  and 
Replay  ISF  with  the  benefit  realized  from  performing  one  additional 
training  Iteration  of  a  cloverleaf  maneuver.  While  use  of  the  Record 
and  Replay  TSF  was  found  to  be  superior  to  the  use  of  the  Automated 
Demonstration,  the  performance  of  a  single  extra  training  trial  in  the 
simulator  produced  better  pilot  performance  than  the  use  of  either  ISF. 
In  this  Instance,  this  particular  instructional  use  of  the  ISFs  made  no 
significant  contribution  to  the  training  effectiveness  of  the  ASPT  for 
that  maneuver. 

Tn  another  relevant  invust ipatlon ,  Hughes,  Llntern,  Wightman, 
Brni.ii'.s,  I'liui  Singleton  '1982)  .sctnlled  two  applications  of  the  Problem 
Frc’ci’c  ISF.  In  tho  " Freer.e/Resot"  application,  the  simulator  was  placed 
on  Freeze  whan  an  error  was  detecleclj  once  the  error  was  explained,  the 
simulated  aircraft  was  pl.aced  In  the  appropriate  position,  and  the 
student  continued  the  task  from  the  "corrected"  position.  In  Vhe  other 
application  called  "Freeze/Flyout,"  the  actions  during  the  Freeze  were 
the  same  as  during  the  Freeze/Reset  condition,  except  the  student 
contlnuod  the  task  from  the  exact  point  at  which  the  simulator  was 
frozen.  Finally,  in  a  third  condition,  students  learned  the  task 
without  the  use  of  tl\e  Freeze  ISF. 

Tho.  result:',  of  this  study  indicated  no  differences  tn  performance 
butwoen  the  two  IHF  applications  and  the  condition  In  which  the  Freeze 
tSF  was  not  used.  The  pilot.s  reported  that  thoy  were  mere  motivated  by 
"trvtng  to  avoid  tlie  'Freeze'  tl\an  bv  trying  to  fly  the  task  correctly." 


Pilots  also  reported  that  trying  to  regain  control  of  the  simulator 
following  a  "Freeze"  significantly  increased  the  difficulty  of  the  task. 
Again*  empirical  testing  of  a  particular  instructional  use  of  ISFs 
revealed  no  significant  advantages. 

One  study  was  found  chat  demonstrated  a  significant  training 
benefit  attributable  to  an  ISF  application.  Bailey,  Hughes,  and  Jones 
(1980)  studied  an  instructional  use  of  Che  Initial  Conditions  (IC)  set 
with  a  dive-bomb  ins  task  in  Che  ASPT.  These  investigators  divided  the 
entire  task  into  seven  segments:  crosswind,  downwind,  base  leg,  roll 
in,  final  dive,  and  release  point.  Using  a  procedure  called  "backward 
chaining,"  the  student  was  placed  at  Che  end  of  final  dive  with  the  IC 
set  and  Chen  learned  the  release  point  segment  to  criterion.  Then  the 
next-to-last  segment — the  final  dive— was  added  to  the  release  point 
segment  and  the  student  learned  the  combined  segments  to  criterion. 
This  "chaining"  of  one  teak  segment  to  an  earlier  one  was  continued, 
using  Che  IC  set  at  each  phase,  until  Che  student  learned  to  perform  the 
task  to  criterion  in  its  entirety. 

The  performance  of  subjects  in  this  backward  chaining  condition 
was  Chen  compared  to  the  performance  of  subjects  who  learned  the  Cask  in 
Che  traditional  manner  in  the  simulator.  The  results  showed  a  statisti¬ 
cally  significant  and  practical  advantage  to  Che  use  of  Che  IC  sec  ISF 
with  the  backward  chaining  procedure.  The  subjects  performed  better  and 
reached  criterion  faster  than  the  traditionally  trained  subjects.  This 
use  of  Che  IC  set  ISF  produced  better  performance  while  also  producing  a 
savings  in  training  time. 


Instructor/Operator  Training 

While  a  programmatic  research  effort  will  identify  cost-effective 
applications  of  ISFs,  this  information  will  be  of  little  benefit  without 
a  cadre  of  well-trained  simulator  instructor/operators.  Review  of  the 
relevant  literature  reveals  a  consensus  that  simuLitor  instructor/ 
operators  are  insufficiently  trained  for  their  complex  and  critical 
role.  T.n  addition,  as  a  research  issue,  Army  simulator  instructor/ 
operator  training  has  received  no  attention. 

Hammell  (in  Rlcard,  Crosby,  &  Lambert,  1982)  provides  clear 
evidence  of  the  criticality  of  the  simulator  instructor/operator.  In  a 
study  of  the  training  effectiveness  of  several  different  levels  of 
fidelity  in  a  shlphandling/ahipbridge  simulator,  the  effects  attribu¬ 
table  to  different  instructors  were  found  to  be  several  tines  larger 
than  the  effects  attributable  to  fidelity  levels.  The  magnitude  of 
instructor  differences  is  surprising  in  that  the  fidelity  levels  studied 
were  specifically  selected  for  their  presumed  Impact  on  training 
effectiveness. 

Charles,  Willard,  and  Healy  (1976)  and  Cray  et  al.  (1981)  con¬ 
ducted  surveys  of  simulator  instructor/operator  training  In  the  Navy, 


and  the  Air  Force,  respectively.  The  results  of  these  surveys  indicate 
that  some  ISFs  are  frequently  not  utilized  at  all,  while  other  ISFs  are 
used  primarily  for  management  rather  than  instructional  purposes. 
Simllarlyi  reports  by  Caro  (1977a)  and  Semple,  Cotton,  and  Sullivan 
(1981b)  Indicate  that  simulator  instructor/operators  are  often  unaware 
of  the  operation  and  capabilities  of  the  IGFs  in  the  simulators  with 
which  they  regularly  train  students.  Wliile  the  generality  of  these 
findings  to  Army  SFTS  instructor/operators  is  unknown,  the  need  to 
examine  and,  if  necessary,  to  augment  their  training  seems  apparent. 


PROPOSED  RESEARCH  PLAN!  INSTRUCTIONAL  SUPPORT  FEATURES 

The  review  of  available  literature  on  ISF  utilization  Indicates 
that  additional,  operationally  oriented  research  is  needed  to  determine 
the  optimal  uses  of  ISFs  in  simulation  training.  This  section  describes 
a  four-phase  research  program  chat  has  the  Cacmlnal  objective  of 
providing  task-level  empirical  data  chat  are  needed  to  identify  the  most 
cost-effective  application  of  ISFs  in  the  Army's  SFTS. 

Figure  S  is  a  flow  diagram  of  the  Casks  that  must  be  accomplished 
Co  meet  the  terminal  objective  of  the  research.  Phase  One  tasks  are 
designed  to  define  the  training  casks,  the  level  of  ISF  automation,  and 
Che  measurement  and  evaluation  methodologies  to  be  used  in  this 
research.  Phase  Two  consists  of  both  analytical  and  empirical  tusks 
chat  are  designed  Co  Identify  potentially  cost-effective  applications  of 
ISFs.  Phase  Three  has  Che  purpose  of  Identifying  training-effective 
applications  of  the  ISFs  identified  in  Phase  Two.  The  objective  of 
Phase  Four  is  to  develop  and  evaluate  a  prototype  Program  of  Instruction 
(POI)  for  both  student  and  Instructor/operators  chat  incorporates  the 
composite  findings  of  the  first  three  phases.  A  detailed  description  of 
each  of  the  research  phases  Is  presented  in  the  sections  that  follow. 


Phase  One 

The  first  pli.-ise  of  the  resenrch  consists  of  four  "up-front" 

analytical  tasks.  The  t.isks  are  designed  to  define  (a)  target  training 
Casks  and  phases,  (b)  desired  level  of  automation,  (c)  performance 

measurement  requirements  and  capabilities,  and  (d)  research  methodology. 
The  products  of  each  of  Che  Phase  One  analytical  tasks  will  serve  as 
inputs  for  the  remaining  phases  of  the  research  program. 

The  four  tasks  addressed  in  Phase  One  are  highly  interrelated  in 
Che  sense  that  decisions  made  about  one  Cask  have  a  major  impact  on  the 
others.  For  instance,  decisions  about  the  degree  to  which  simulator 

training  is  automated  will  have  a  major  impact  on  the  performance 

measurement  capability  that  is  required.  Conversely,  costs  and  techno¬ 
logical  constraints  may  pl.ice  limitations  on  performance  measurement 
that,  in  turn,  may  make  it  Impossible  to  achieve  Che  desired  level  of 
training  automation.  Because  of  such  interdependencies,  there  is  no 


logical  order  In  which  to  conduct  the  Phase  One  tasks.  They  must  be 
conducted  concurrently  and,  in  all  probability,  several  analytical 
iterations  will  be  required  before  final  decisions  can  be  made.  Data 
provided  by  this  task  will  be  used  as  input  to  each  of  the  remaining 
three  phases  of  Che  research  program. 


Define  Target  Training  Tasks 

The  objective  of  this  cask  is  to  compile  a  comprehensive  inventory 
of  simulator  training  tasks  for  which  skill  acquisition  may  be 
facilitated  by  Che  use  of  ISFs.  These  casks  are  referred  to  hereafter 
as  "target"  training  Casks.  An  inventory  of  target  training  tasks  will 
be  compiled  for  lERW  training,  transition  training,  instrument  training, 
and  continuation  training. 


Define  Desired  Level  of  Automation 

The  purpose  of  the  second  Cask  in  Phase  One  Is  to  define  the 
desired  level  of  training  feature  automation.  A  necessary  first  stsp  In 
achieving  this  objective  is  to  make  decisions  about  whether  the  slmuls- 
Clon  training  is  best  accomplished  with  an  instructor  pilot,  a  simulator 
operator,  a  completely  self-instructional  capability,  or  some  combina¬ 
tion  of  these  training  management  approaches.  Factors  that  must  be 
considered  along  with  the  training  management  approach  include:  avail¬ 
able  technology,  cost,  device  quantities,  and  student  throughput, 


Define  Performance  Measurement  Requirements 

The  third  Cask  in  Phase  One  is  the  definition  of  performance 
measurement  system  requirements.  As  indicated  above,  the  level  of 
instructional  automation  Judged  optimal  will  influence  performance 
measurement  requirements. 


Define  Research  Methodology 

The  objective  of  the  fourth  and  final  task  in  Phase  One  is  to 
develop  the  research  methodology  to  be  used  during  Phase  Two.  A 
suitable  research  methodology  must  yield  data  with  which  to  make 
decisions  about  the  cost  effectiveness  of  potentially  effective  ISFs, 
individually  and  collectively.  Equally  important,  a  suitable  research 
methodology  must  enable  the  requisite  data  to  be  collected  at  a 
reasonable  cost.  Ordinarily,  transf er-of-trainlng  data  are  essential 
for  assessing  the  cost  effectiveness  of  simulators  or  simulator 
components.  Although  transf er-of-craining  studies  certainly  would 
provide  the  data  needed  to  .sssoss  the  cost  ei' fee  t  iveness  of  ISFs,  such 
studies  are  so  costly  and  difficult  to  accomplish  that  every  attempt 
must  be  made  to  develop  a  suitable  alternative  researcli  approach. 


Because  this  issue  Is  so  critical,  alternatives  to  transfer-of- 
tralnlng  research  were  carefully  considered  In  developing  the  research 
plan  for  ISFb.  The  main  Idea  that  emerged  from  these  conslderatlonn  Is 
that  most  or  all  of  the  benefits  of  ISFs  will  be  manifest  In  a  reduction 
In  simulator  training  time  rather  than  a  reduction  In  subsequent 
aircraft  training  time.  Stated  differently,  effective  ISFs  should 
decrease  the  amount  of  time  that  an  aviator  needs  to  reach  a  given  level 
of  proficiency  In  the  simulator;  but,  there  Is  no  reason  to  believe  that 
an  aviator  trained  with  ISFs  would  require  less  subsequent  aircraft 
training  than  another  aviator  trained  t..  the  same  level  of  proficiency 
In  a  simulator  without  the  benefit  of  ISFs.  If  this  hypothesis  is 
valid,  the  cost  effectiveness  of  ISFs  could  be  assessed  by  comparing  the 
life-cycle  coats  of  the  ISFs  with  the  dollar  value  of  the  simulator 
training-time  savings  attributable  to  the  use  of  ISFs.  In  short,  all 
the  data  needed  to  assess  the  cost  effectiveness  of  ISFs  could  be 
collected  In  a  simulator  known  to  yield  training  transfer. 

The  remainder  of  the  discussion  of  ISF  research  assumes  that  the 
only  benefits  of  ISFs  are  ones  chat  result  from  an  increase  In  Che 
efficiency  with  which  simulator  training  can  be  accomplished,  However, 
It  will  be  necessary  to  validate  this  assumption  before  research  on  ISF 
utility  Is  Initiated, 


Phase  Two 

The  second  phase  of  the  research  program  Is  composed  of  three 
major  Casks;  (a)  development  of  an  Inventory  of  potentially  effective 
ISFs  and  their  applications,  (b)  development  of  an  optimal  sequence  of 
ISF  applications,  and  (c)  definition  of  cost-effective  applications  of 
ISFs.  A  detailed  description  of  each  of  these  tasks  Is  presented  below. 


Derive  Potentially  Effective  Instructional  Feature  Applications 

The  first  task  in  Phase  Two  is  the  development  of  an  inventory  of 
potentially  effective  ISFs  and  applications  of  those  instructional 
features.  All  devices  in  the  Army's  SFTS  will  be  examined  and  all  ISFs 
incorporated  in  these  devices  and  their  potential  training  applications 
will  be  Identified  and  described.  A  review  of  U.S.  and  foreign  military 
'And  commercial  flight  simulators  will  be  conducted  to  Identify  ISFs  not 
presently  used  in  the  Army  SFTS.  Potential  applications  of  these  ISFs 
will  be  specified.  Finally,  simulation  experts  and  other  subject-matter 
experts  (SMEs)  will  be  questioned  about  their  ideas  regarding  training 
concepts  for  which  ISF  applications  could  be  developed.  The  product  of 
this  task  will  be  a  comprehensive  Inventory  of  potentially  effective  ISF 
applications, 
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Define  Optimal  Instructional  Sequence 

The  next  task  In  Phase  Two  la  a  definition  of  an  optimal  Instruc¬ 
tional  sequence!  This  task  Is  Included  In  Phase  Two  because  of  Its 
potential  contribution  to  the  empirical  research  to  be  conducted  within 
this  phase.  Three  types  of  effort  are  needed  to  meet  the  objectives  of 
the  task. 

The  first  effort  will  be  an  attempt  to  analyze  the  tasks  identi¬ 
fied  in  Phase  One  as  targets  for  training.  Th  ■  objectives  of  the  effort 
are  (a)  to  Identify  common  task  "types"  or  groupings  so  that  the  number 
of  research  tasks  may  be  reduced,  and  (b)  to  permit  logical)  analytical 
decisions  regarding  the  optimal  order  in  which  tasks  should  be  trained. 
To  achieve  these  objectives,  an  analysis  of  enabling  task  components 
such  as  chat  conducted  by  Meyer,  Laveson,  Pape,  and  Edwards  (1978)  Is 
proposed. 

Given  an  Identification  of  optimal  task  order  for  training,  the 
second  effort  is  to  conduct  comparisons  between  the  analytically  derived 
task  order  and  the  operational  task  orderCs).  The  extent  of  the 
disparity  between  the  two  task  orders  will,  In  large  part,  datarmina 
whether  there  Is  a  nead  to  empirically  compare  these  two  task  ordars. 
The  greater  the  discrepancy  that  exists  between  the  task  orders,  the 
greater  will  be  the  need  for  empirical  evaluation. 

The  third  effort  required  to  determine  an  optimal  instructional 
sequence  is  the  Identification  of  Che  optimal  order  In  which  simulator 
training  and  aircraft  training  Is  conducted.  In  the  only  relevant 
investigation  found  in  the  literature,  Ryan,  Scott,  and  Browning  (1979) 
found  that  a  blocked  simulation  training  group  required  significantly 
fewer  trials  to  criterion  (17)  chan  either  an  intarspersed  simulator/ 
aircraft  group  (28)  or  an  aircraft-only  trained  group  (50),  The  large 
and  operationally  significant  differences  obtained  in  this  study,  while 
accepted  with  caution,  suggest  Che  possible  importance  of  determining 
optimal  sequences  of  simulator  and  aircraft  training. 

In  designing  rese.nrch  to  determine  optimal  sequences  of  simulator 
and  aircraft  tts-iining,  several,  factors  must  be  considered.  First,  It 
will  be  necessary  to  conduct  the  research  in  the  context  of  both  initial 
skill  acquisition  and  sustainment  training.  Second,  Che  effects  of 
interspersed  training  might  be  expected  to  he  mediated  by  skill  level. 
Thus,  it  will  be  necessary  to  vary  the  point  at  which  students  who  are 
trained  initially  in  the  simulator  begin  training  in  the  aircraft,  and 
vice  versa.  Finally,  the  frequency  with  which  subjects  switch  from  the 
simulator  to  the  aircraft  is  important  and  must  be  varied  experi¬ 
mentally.  The  product  of  this  task  will  be  the  definition  of  an  optimal 
training  sequence. 


Define  Cost-Ef fecclve  Instructional  Support  Feature  Applications 

The  final  task  in  Phase  Two  is  to  deflns  .oyc -effective  applica¬ 
tions  of  instructional  support  features.  P^th  analytical  work  and 
empirical  work  will  be  performed  to  Identify  applications  that  are 
cost  effective.  The  analytical  components  of  the  task  are  designed  to 
reduce  the  number  of  ISF  applications  for  which  empirical  data  are 
needed  to  make  decisions  based  upon  cost  effoctlveneas. 

Figure  6  is  a  diagram  of  the  seeps  to  be  accomplished  and  the 
decisions  that  will  be  made  to  eccomplish  the  final  task  in  Phase  Two. 
Products  of  each  of  the  earlier  tasks  will  be  used  as  input  to 
accomplish  the  task  objective. 

Step  One  of  the  task  consists  of  the  development  of  a  Target 
Training  Task  by  ISF  Application  Matrix.  Target  training  tasks  and 
phases  were  identified  in  the  first  task  of  Phase  One;  potentially 
effective  applications  of  ISFs  were  identified  in  the  first  task  of 
Phase  Two.  The  matrix  will  show  all  possible  applications  of  the  ISFs 
identified  in  Phase  Two  to  each  of  the.  training  tasks  identified  in 
Phase  One. 

In  Step  Two  of  this  task,  the  known  and  the  aaaumed  capabilities 
and  limitations  of  each  ISF  application  In  the  matrix  will  ba  defined. 
SMEs  will  be  consulted  as  necessary  during  the  development  of  the 
definitions , 

The  use  of  SME  judgments  assumes  that  decisions  about  the  cost 
effectiveness  of  some  ISFs  can  be  based  solely  upon  analytical  consider¬ 
ations.  For  example,  it  is  likely  that  the  Initial  Conditions  Set  ISF 
would  be  Judged  cost  effective  by  most  SMEs.  The  capability  to  position 
the  oircraft  at  any  position  over  the  available  terrain  olimlnates  the 
time  required  to  fly  to  that  position.  That  application  alone  is  likely 
to  make  Che  Initial  Conditions  Set  ISF  a  costref fective  one.  Given  Che 
Initial  Conditions  Sut  ISF,  a  Problem  Fi  eze  ISF  would  likely  be  judged 
cost  effective  in  that  it  enables  the  instructor/operator  to  stop  the 
training  at  any  point  and  utilize  the  Initial  Conditions  Set  ISF  to 
change  position  or  other  relevant  environmental  conditions.  These  types 
of  decisions  about  the  cost  effectiveness  of  pprticu.lar  ISF  applications 
can  be  made  without  extensive  empirical  effort. 

A  more  empirical  approach  is  required  for  ISFs  whose  cost  effec¬ 
tiveness  in  less  obvious.  As  the  above  example  illustroCes,  certain 
ISFs  are  interrelated.  Decisions  about  the  cost  effectiveness  of  a 
single  ISF  application  must,  therefore,  be  made  in  the  context  of  other 
ISFs  that  support,  or  supplement  its  utility. 

A  series  of  steps  will  be  followed  in  the  empirical  phase  of  data 
collection.  First,  research  scientists,  simulator  instructors/ 
operators,  and  other  SMEs  will  be  educated  about  the  known  and  assumed 
capabilities  and  limitations  of  each  ISF  application.  The  SMEn  will 
then  be  n.sked  to  judge  the  potential  training  utility  of  each  ISF 
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appllcaclon  on  a  task-by-Cask  basis.  If  an  appllcaciou  is  Judged  to 
clearly  have  training  utility  for  a  number  of  tasks,  the  application 
will  be  selected  for  Incorporation  Into  a  prototype  POI  for  Instructors/ 
operators.  If  an  application  Is  judged  to  have  no  potential  training 
utility,  the  application  of  the  XSF  will  either  be  rejected  or  a  recom¬ 
mendation  will  be  made  to  study  the  application  further  within  a  longer- 
term  research  program.  The  ISF  applications  that  remain  will  be  those 
for  which  the  potential  training  utility  is  uncertain.  These  applica¬ 
tions  are  considered  to  be  the  best  candidates  for  further  empirical 
evaluation. 

The  Inventory  of  potentially  effective  ISF  applications  Is  likely 
to  contain  several  ISFs  and  ISF  applications  that  are  beyond  the 
hardware  and  the  software  capabilities  of  the  existing  devices  in  the 
SFTS.  Investigation  of  the  training  utility  of  those  ISFs  will  be 
recommended  as  part  of  the  longer-term  research  program  mentioned 
previously. 

The  next  step  In  the  task  Is  to  design  and  conduct  empirical 
evaluations  of  the  cost  effeetlvenesa  of  the  ISF  applications  that  are 
within  the  capabilities  of  the  devices  In  the  SFTS.  Using  the  general 
research  methodology  defined  in  Phase  One,  each  ISF  application  will  be 
evaluated  in  terms  of  Its  cost  effectiveness  when  compared  to  approp¬ 
riate  control  groups,  The  specific  research  designs  and  the  measurement 
approaches  to  be  used  will  be  determined  by  the  nature  of  the  ISF 
application  to  be  evaluated  and  the  raaources  available  for  that  effort. 
Applications  that  are  found  to  be  coat  effective  will  be  incorporated 
Into  the  prototype  instructor/operator  POI.  Applications  chat  are  found 
not  to  be  cost  effective  will  be  either  eliminated  from  further  consid¬ 
eration  or  recommended  for  further  study  in  a  longer-term  research 
program. 

In  summary,  the  analytical  and  empirical  analyses  in  this  Cask 
will  provide  information  that  can  be  used  to  make  decisions  about  the 
outcomes  of  ISF  applications.  Specifically,  the  task  results  will  be 
used  to  determine  whether  a  particular  TSF  application  will  be  (a) 
included  in  a  prototype  Instructor /operator  POI,  (b)  recommended  for 
further  study  in  a  longer-term  rese.irch  program,  or  (c)  eliminated  from 
further  consideration. 

ISF  applications  will  be  Irt'cluded  in  the  prototype  instructor/ 
operator  POI  when  either  of  the  following  conditions  is  met: 

•  The  ISF  application  la  judged  by  SMEs  to  have  training  utility 
for  a  number  of  casks. 

•  The  ISF  application  is  within  the  capabilities  of  the  existing 
SFTS  and  is  determined  by  empirical  methods  to  be  cost 
effective. 

ISF  applications  may  be  recommended  for  further  study  in  a 
longer-tenn  research  program  when  any  of  the  following  conditions  are 


•  The  ISF  application  Is  Judged  by  SMEs  to  have  no  potential 
training  utility. 

•  The  training  utility  of  the  ISF  application  Is  judged  by  SMEs  to 
be  uncertain  and  the  application  la  beyond  the  capabilities  of 
the  existing  SFTS. 

e  The  ISF  application  la  beyond  the  capabilities  of  the  existing 
SFTS  and  la  Judged  by  SMEs  to  have  potential  training  utility, 

ISF  applications  may  be  eliminated  from  further  consideration 

when! 

•  The  ISF  application  la  Judged  to  have  no  potential  training 
utility , 

•  The  ISF  application  Is  within  the  capablllCtes  of  the  existing 
SFTS  and  Is  Judged  by  SMEs  to  have  potential  training  utility) 
but  Is  determined  in  empirical  evaluations  not  to  be  cost 
effective. 


Phase  Three 

The  objective  of  Phase  Three  Is  to  define  near-optimal  instructor/ 
operator  training  techniques.  The  training  techniques  of  concern  here 
are  those  techniques  that  are  mediated  by  the  instructor/operator  and 
are  used  either  alone  or  in  conjunction  with  ISF  applications.  Examples 
of  such  Instructor/operator  training  techniques  include  the  type  and 
frequency  of  verbal  prompting,  briefing  and  debriefing  atrategiesi  and 
the  type  and  frequency  of  corrective  and  evaluative  feedback,  The 
product  of  this  phase  will  be  a  list  of  Instructor/operator  mediated 
training  techniques.  This  list  of  training  techniques  will  then  be 
Incorporated  Into  the  prototype  POI  to  be  developed  in  the  fourth  and 
final  phase  uf  this  research. 


Data  Collection  Techniques 

Two  sources  of  information  will  be  used  to  define  near-optimal 
instructor/operator  mediated  training  techniques,  The  first  source  of 
information  is  a  review  of  the  training  literature.  This  review  will 
focus  upon  training  principles  and  procedures  appropriate  for  training 
particular  kinds  of  tasks.  For  example,  research  will  be  reviewed  on 
prompting  and  fading,  discrimination  and  generalization,  practice, 
overlearning,  intrinsic  and  extrinsic  feedback,  and  the  relation  between 
these  principles  and  transfer.  Attempts  will  be  made  to  relate  each 
principle  to  specific  tasks  and/or  task  types.  One  product  of  this 
review  will  be  an  instructional  program  for  simulator  instructors/ 
operators,  utilizing  relevant  flight  tasks  as  examples  of  how  to  use 
these  principle;:  In  training. 


The  second,  and  nose  imporcanC,  source  of  relevant  Information  Is 
the  expert  and  successful  simulator  Instructor/operator .  It  Is  presumed 
that  there  are  simulator  Instructors/operators  who  are  successful  in 
utilizing  a  device  to  train  students.  It  is  also  presumed  that  there 
are  methods  for  identifying  these  Individuals.  Given  the  existence  of 
expert  and  successful  simulator  instructors/operators,  and  the  apparent 
lack  of  knowledge  concerning  that  expertise  in  the  simulation  and 
training  communities,  it  remains  for  researchers  to  observe  the  behavior 
of  these  Instructors/operators.  Accurate  and  detailed  records  of  their 
activity  would  produce  information  most  useful  to  Che  design  of  a  POX 
for  other  simulator  instructors/operators. 

Provisions  for  direct  observation  of  these  instructors/operators 
during  normal  training  periods  would  be  required.  An  unobtrusive 
observer  with  visual  and  auditory  access  to  Che  instructor,  the  student, 
and  to  relevant  aspects  of  Che  device  would  be  required.  A  carefully 
prepared  and  pretested  behavior  checklist  would  enable  Che  observer  to 
record,  on  a  Cask-by-Cask  basis,  Che  training  activities  of  the 
instructors/operators. 

The  products  of  this  task  will  be: 

•  a  list  of  relevant  training  principles  and  procedures 
appropriate  to  specific  tasks.  Cask  types,  or  both, 

•  an  instructional  program  on  the  use  of  training  principles  and 
procedures  with  flight  casks,  and 

•  a  description  of  the  '  instructional  activities  of  expert 
instructors/operators  on  a  task-by-task  basis. 

The  condensation  of  this  information  should,  in  large  part,  yield 
the  data  necessary  to  define  optimal  instructor/operator  training 
techniques . 


Phase  Four 

The  objective  of  the  fourth  and  final  phase  of  this  research  is 
the  development  and  evaluation  of  a  prototype  POI  for  simulator 
instructors/operators.  The  products  of  each  of  the  previous  phases  of 
research  will  be  incorporated  into  the  design  of  the  prototype  POI. 


Development  of  the  Prototype  POI 

Current  simulator  instructor/operator  training  will  be  analyzed. 
The  analysis  will  focus  upon  the  specific  syllabi,  the  academic 
training,  and  the  simulator  training  conducted  for  instructors/ 
operators.  Program  hours  and  formats  will  be  examined  to  form  a  base- 
Jini-'  for  the  prototype  POI. 
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The  prototype  POI  will  be  constructed  as  described  in  the  third 
task  of  Phase  Two,  and  submitted  for  SME  review.  Revisions  will  be  made 
based  upon  the  results  of  that  review.  The  prototype  POI  will  Chen  be 
submitted  to  empirical  evaluation. 


Evaluation  of  Che  Prototype  POI 

Several  alternative  strategies  are  available  to  empirically 
evaluate  the  prototype  POI.  Decisions  about  the  evaluation  strategy*  or 
strategies,  to  be  employed  will  be  made  based  upon  the  content  and 
structure  of  Che  draft  POI  and  the  resources  available  Co  conduct  Che 
evaluation.  One  alternative  is  to  move  directly  to  an  evaluation  of  the 
effect  that  the  draft  POI  has  on  Instructor/operator  and  subsequent 
student  behavior.  With  this  approach,  Che  draft  POI  itself  would  serve 
as  the  independent  variable.  A  two-group  comparison  between  a  POI- 
trained  group  and  a  current  program-trained  group  would  be  conducted. 
Measures  of  both  instructor  behavior  and  student  behavior  in  the 
simulator  would  be  obtained. 

A  second,  and  perhaps  more  desirable,  alternative  is  to  derive 
testable  hypotheses  from  the  results  of  Phase  Three.  By  relating  Che 
observational  records  of  expert  instriictors/operators  to  specific 
training  principles  and  procedures,  several  questions  will  arise  con¬ 
cerning  the  efficacy  of  certain  training  principles  and  procedures.  It 
should  be  possible  to  resolve  a  number  of  these  questions  analytically. 
The  remaining  questions  would  be  stated  in  testable  form.  These  ques¬ 
tions  would  form  Che  basis  of  a  programmatic  series  of  investigations  of 
instructional  variables.  The  results  of  the  programmatic  training 
research  would  serve  as  empirical  bases  for  the  content  of  the  draft 
POI.  This  POI  could  then  be  evaluated  with  the  two-group  comparison 
described  above, 

A  third  approach  to  the  evaluation  of  the  draft  POI  is  to  directly 
test  the  components  of  the  draft  POI.  A  component  analysis  would  allow 
separate  determination  to  be  mad^i  of  the  effects  of  independent  segments 
of  the  POI.  Emphasis  here  would  be  placed  on  Ins t ructor/operator 
behavior  as  the  primary  dependent  measure.  The  specific  constitution  of 
the  POI  will  determine  the  manner  in  which  it  is  to  be  segmented.  For 
example,  feedback  components  of  the  POI  could  be  introduced  in  one 
segment  followed  by  a  prompting  segment  and  a  fading  segment. 

Measures  of  feedback,  prompting,  and  fading  behaviors  would  be 
obtained  throughout  the  evaluation  procedure.  Inferences  about  the 
effects  of  each  component  would  be  drawn  by  a  comparison  of  the  relevant 
measure  prior  to  and  following  the  Introduction  of  the  corresponding 
component  of  the  POT.  The  draft  POI  constructed  through  the  empirical 
evaluation  of  its  various  component.^  could  then  be  compared  to  the 
current  instructor/operntor  training  progr.nm  in  terms  of  its  effect  on 
instructor/operator  behavior  and  on  student  performance  in  the 
simulator, 


SECONDARY  RESEARCH  AREAS 


The  remaining  portion  of  this  section  discusses  nine  "secondary" 
research  areas#  As  was  stated  earlier,  th  '  are  problems  and  uncer¬ 
tainties  in  each  of  these  secondary  areas  tl  must  be  resolved  in  order 
to  conduct  effective  research  in  the  areas  o#  primary  concern;  simula¬ 
tor  fidelity  and  Instructional  support  features.  The  discussion  of  each 
of  the  secondary  research  areas  Is  aimed  at  defining  the  nature  of  Che 
problems;  no  attempt  has  been  made  to  formulate  a  research  plan  to 
investigate  each  of  the  problems. 

HELICOPTER  FLYING-TASK* ^  DATA  BASE 

There  is  a  great  need  within  Army  aviation  to  develop  a  compre¬ 
hensive  data  base  on  the  tasks  that  helicopter  aviators  must  be  able  to 
perform  in  order  to  achieve  full  operational-ready  status.  Within  the 
present  context,  the  need  for  such  a  data  base  centers  on  the  develop¬ 
ment  and  assessment  of  training  methods  and  media.  However,  a  compre¬ 
hensive  flying-task  data  base  is  also  needed  for: 

e  the  development  and  validation  of  improved  aviator  selection 
tests; 

e  the  development  and  validation  of  improved  proficiency  assess¬ 
ment  measures  for  Individual  aviators,  aircraft  crews,  mulclple- 
aircraft  teams,  and  combined-arms  teams; 

e  human  factors  design  of  new  aircraft  and  new  equipment  developed 
for  use  in  existing  aircraft;  and 

•  the  development  or  refinement  of,  operational  procedures  and 
tactics. 

The  flying-task  data  requirements  for  each  of  the  applications 
mentioned  above  have  some  unique  elements,  but  there  are  a  great  many 
data  requirements  that  are  common  to  two  or  more  of  the  applications. 
Due  to  the  commonality  in  task  data  requirements,  there  has  been  an 
enonnous  amount  of  duplication  of  effort  in  the  compilation  of  flying- 
C.TSk  data  by  different  Army  and  industrial  organizations.  In  addition 
to  the  problem  of  duplication  of  effort,  there  have  been  problems  with 
data  quality  and  data  standardization.  Because  of  the  limited 
resources — time,  funds,  and  personnel  expertise — that  any  one  organiza¬ 
tion  can  bring  to  bear  in  compiling  flying-task  data,  there  have  been 
instances  in  which  the  resulting  data  have  not  been  as  complete  and 
valid  as  the  user  needs  to  do  the  job.  Lack  of  standardization  in  the 
task  analysis  methods  employed,  the  type  of  task  data  compiled,  and  the 
descriptors  used  to  characterize  flying  tasks  have  resulted  in 


' ^The  tern  "flying  tasks,"  as  used  here,  encompasses  all  preflight 
planning  tasks  performed  on  the  ground  as  well  as  all  tasks  performed 
in  tlie  .lir,  whether  or  not  the  tasks  involve  control  of  the  aircraft. 
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inefficiency  and  mlsconununication  when  Che  data  have  been  used  by 
organizations  other  Chan  the  one  Chat  developed  the  data. 

The  requirements  and  problems  discussed  above  point  to  the  need 
for  a  comprehensive  I  standardized  data  base  on  helicopter  flying  Casks. 
The  development  and  maintenance  of  such  a  data  base  would  be  costly. 
However,  in  Che  long  run,  such  a  data  base  would  surely  result  in  coat 
savings  through  eliminating  duplication  of  effort  and  increasing 
effectiveness  in  performing  Jobs  that  require  flying-task  data. 

Numerous  technical  problems  must  be  overcome  in  developing  a 
flying-task  data  baae.^*^  Probably  the  most  difficult  problem  is  chat  of 
creating  a  meaningful  conceptual  structure  for  organizing  Che  data. 
Ocher  difficult,  but  less  formidable  problems.  Include: 

•  identifying  the  potential  users  of  the  data  base  and  specifying 
Che  needs  of  each  user; 

•  specifying  the  composite  set  of  data  items  needed  to  satisfy  the 
requirements  of  each  user; 

•  developing  standardized  data-collection  methods,  especially 
methods  for  conducting  task  analyses  for  new  aircraft  and  new 
systems  Co  be  installed  in  operational  airframes; 

a  developing  standardized  descriptors  for  use  in  defining 
missions,  mission  segments,  functions,  flying  tasks,  operator 
tasks,  operator  subCasks,  operator  actions,  etc.;  and 

e  specifying  Che  manner  in  which  the  data  are  to  be  formatted, 
assessed,  and  updated. 


Identify  Data-Base  Users/Needa 

An  effort  to  develop  a  flying-task  data  base  must  commence  with 
the  identification  of  the  Array  organizations  that  must  employ  such  data 
in  accomplishing  their  job.  Then,  it  will  be  necessary  to  survey 
representatives  of  each  organization,  using  questionnaires  and/or 
interviews,  to  Identify  Che  types  oi  jobs  for  which  flying-task  data  are 
required  and  the  specific  data  items  needed  to  nccomplish  that  job.  The 
composite  findings  of  Che  user  survey  will  serve  as  the  basis  for 
formulating  a  set  of  general  data-base  requirements. 


^‘*Many  of  the  research  problems  and  issues  discussed  by  Hays  (1981)  and 
by  Hays  and  Singer  (1983)  are  germane  to  the  development  of  a 
helicopter  flying-task  data  base.  Their  writings  have  had  a  major 
influence  on  the  ideas  presented  in  this  subsection. 


Define  Data-Base  Structure 


In  developing  a  data-base  structural  It  must  be  kept.  In  mind  that 
there  Is  no  single  set  of  data  Items  and  no  single  data-base  organiza¬ 
tion  that  will  be  satisfactory  for  all  users.  As  a  consequence.  It  Is 
essential  that  the  flying-task  data  base  be  computerized  and  that  the 
computerized  data  be  formatted  In  a  way  that  will  enable  users  to 
organize  the  data  in  a  manner  that  best  suits  their  needs.  Although  the 
data  will  be  organized  and  processed  in  various  ways  by  various  users, 
It  is  necessary  to  develop  a  conceptual  structure  that  will  (a)  provide 
guidance  In  making  decisions  about  data  formatting  and  data  accession 
methods,  and  (b)  enable  users  to  conceptualize  the  contents  of  the  data 
base  and  how  to  go  about  organizing  It  to  meet  their  needs.  The 
comments  presented  below  reflect  only  preliminary  thoughts  about  a 
data-base  structure. 

As  presently  conceived,  the  mainstay  of  the  data-base  structure 
would  be  a  fully  comprehensive  listing  of  mutually  exclusive  flying 
tasks. Some  flying  tasks  would  be  defined  In  terms  of  aircraft 
actions,  such  as:  ground  taxi,  takeoff  to  a  hover,  steep  approach, 
circling  approach,  autorotatlon,  etc.  Ocher  flying  tasks  would  be 
defined  In  terms  of  discrete  tasks  an  aviator  must  accomplish  on  the 
ground  (plan  an  IFR  flight,  prepare  performance  planning  card,  etc.)  or 
In  the  air  (perform  emergency  procedure  for  emergency  landing,  fire 
2.75-lnch  FFAR  rocket  launcher,  etc.).  The  concept  Is  to  define  flying 
tasks  such  that  they  can  be  used  as  discrete  "building  blocks"  In 
describing  operational  missions  or  training  sessions.  To  be  acceptably 
comprehensive,  Che  flying-task  listing  must  contain  the  flying  tasks 
needed  to  describe  any  operational  mission  or  training  session  for  any 
aircraft  flying  under  any  condition  In  which  Army  helicopters  might  be 
required  to  operate,  In  short,  the  flying-task  listing  must  encompass 
the  full  range  of  missions  (Including  training),  aircraft  types,  topog¬ 
raphy,  weather  conditions,  lighting  conditions,  and  battlefield- 
generated  visual  obscurants. 

An  essential  requirement  of  the  training-task  listing  is  that  the 
tr.ijning  casks  he  defined  at  a  common  and  useful  level  of  specificity. 
The  enormous  variation  in  task  specificity  is  one  of  the  reasons  it  is 
difficult  to  use  ATM  tasks  in  designing  training  system  research.  Some 


^^Thls  effort  is  similar  but  not  identical  to  the  development  of  a 
flying-task  taxonomy.  The  ideal  flying-task  data  base  would  enable 
different  users  to  develop  taxonomies  specifically  tailored  to  their 
needs.  That  is,  the  fundamental  tasks  and  associated  data  listed  in 
the  data  base  could  be  organized  and  classified  in  terms  of  a  variety 
of  different  behavioral  or  nonbehavloral  criteria.  The  work  of  Meyer 
and  his  associates  illustrates  Che  types  and  uses  of  taxonomies  Chat 
could  be  developed  from  the  envisioned  flying-task  data  base  (Meyer, 
Laveson,  S  Welssraan,  1974;  Meyer,  Laveson,  Weissman,  4  Eddowes,  1974; 
Meyer,  Laveson,  Pape,  &  Edwards,  1978). 
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ATM  Casks,  such  as  "hovering  Cucns,"  are  defined  at  such  a  high  degree 
of  speciflclcy  that  it  facilitates  specific  thought  about  methods  and 
media  Chat  would  promote  training  on  the  task.  Other  ATM  tasks,  such  as 
"route  reconnaissance,"  are  defined  at  a  level  of  speciflclcy  that  is 
far  too  general  Co  be  of  use  for  most  analytical  purposes.  A  route 
reconnaissance  subsumes  numerous  ocher  ATM  tasks  that  differ  greatly  In 
the  knowledge  .and  skills  required  to  master  them.  Such  casks  must  be 
subdivided  Into  finer  units  to  promote  more  detailed  and  systematic 
consideration  of  training  methods  and  media.  Variation  In  Che  level  of 
specificity  of  flying-task  definitions  probably  would  create  similar 
problems  for  data-base  applications  other  than  training  research. 

The  data-base  structure  envisioned  would  consist  of  a  very  large 
three-dimensional  matrix  with  flying  tasks  listed  along  one  axis, 
aircraft  types  listed  along  a  second  axis,  and  flying  conditions  listed 
along  a  third  axis.  Each  cell  in  the  matrix  would  contain  data  elements 
germane  to  the  corresponding  flying  task,  aircraft  type,  and  flying 
condition.  The  data  items  stored  within  each  cell  of  the  matrix  are 
discussed  in  the  following  subsection. 


Sptclfy  Data  Items 

Initially,  the  data  items  to  be  Included  In  the  data  base  will  ba 
specified  through  an  analysis  of  the  information  generated  by  the  user 
survey.  Subsequently,  user  feedback  will  be  used  to  expand  snd/or 
refine  the  population  of  data  items.  Two  classes  of  data  items  are 
needed:  flylng-cask  descriptors  and  operator-task  descriptors.  Flying- 
task  descriptors  should  include  at  least  Che  following: 

•  a  general  description  of  the  flying  task  for  the  aircraft/ 
condlClon(B)  in  question; 

•  Identification  of  all  personnel  who  are  directly  or  Indirectly 
Involved  in  performing  the  flying  task,  including  crews  of  other 
aircraft  and  ground  personnel; 

•  .specific  perfortnnnce  criteria  and  standards  for  the  flying  task; 
and 

•  enabling  flying  tasks — the  flying  tasks  that  iriu.st  be  mastered 
before  effective  training  on  the  task  in  question  Is  possible, 

•I 

The  data  items  referred  to  as  "operator-task  descriptors" 
correspond  closely  with  traditional  task-analysts  data.  As  the  term 
Implies,  all  operator-task  descriptors  arc  aimed  at  characterizing  what 
the  operator  must  do  to  accomplish  a  specific  flying  task.  While  by  no 
means  complete,  the  following  list  exemplifies  the  types  of  operator- 
task  descriptors  that  should  be  included  in  the  data  base;  such  data 
will  be  required  for  each  individual  who  participates  in  the  flying  task 
i.n  question: 


•  verbal  description  of  each  function)  task,  and  subcask  that  mtisc 
be  performed  Co  accomplish  Che  flying  task  In  quescion^^; 

•  Che  exact  sequence  In  which  Che  functions)  tasks )  and  subcasks 
must  be  performed.  If  applicable; 

•  the  operator  knowledge/sklll  requirements  for  each  operator 
Caak/aubtaak; 

•  the  displays  that  must  be  referred  to  and  the  controls  that  roust 
be  manipulated  to  accomplish  each  operator  task/subtask; 

e  the  extra-cockpit  visual  Information  required  to  accompllsli  each 
cask/subtask; 

•  Che  nonvlsual  cues  required  to  accomplish  each  Cask/subtask; 

•  the  type  and  source  of  other  Information  required  to  perform 
each  cask/subtask; 

•  ratings  of  task/aubcask  difficulty  (to  learn  and  to  perform  by 
trained  aviators) ; 

s  ratings  of  Cask/subtask  criticality  (safety  and  mission 

success) ; 

e  time  requlrsd  to  perform  Cask/subtask  (avtrags  time,  maximum 
time,  and  minimum  tlma); 

a  rating  of  Cask/aubCaak  In  terms  of  tolerance  for  voluntarily 
delaying  the  cask/subtask  when  workload  la  high;  and 

•  cask/subtask  claaa  (control,  Information  processlngi  decision 
making)  ate.). 

Not  all  of  the  data  Hated  above  are  presently  available;  much  of 
the  data  would  be  difficult  to  acquire.  However,  all  of  the  data  Items 
listed  are  believed  to  be  needed  by  one  or  more  Army  organlaatlons. 
And,  as  was  suggeaced  earlier,  there  undoubtedly  are  other  data  needed 
that  are  not  Included  in  the  shove  list. 


Develop  Methods  for  Formatting,  Accessing,  and  Updating  Data  Base 

Little  can  bu  said  at  this  point  about  the  development  of  methods 
for  formatting,  accessing,  and  updating  the  data  except  that  these,, 
methods  must  be  specifically  tailored  to  the  needs  and  capabilities  of 
the  users.  Ac  this  point,  It  seems  clear  that  the  system  must  be 
designed  for  Individuals  who  are  relatively  unsophisticated  In  computer 
operations  and  Infrequent  users  of  the  data  base.  It  also  seems  clear 
that  Che  system  must  be  designed  in  such  a  manner  that  enables  users  to 
easily  select  from  the  composite  data  base  data  Items  that  are  of 
interest  and  to  organize  the  data  In  a  way  that  best  suits  their  needs. 

s tandardlned  set  of  verbs  (acquire,  control,  check,  engage,  etc.) 
should  be  used  In  drafting  the  taak/suhtask  descriptions. 


TEAM/COMBINED-ARMS  TRAINING 


Current  Army  doctrine  dictates  that,  when  engaged  in  combat 
operations t  a  helicopter  crew  nearly  always  operates  as  part  of  a  larger 
team.  The  team  may  consist  of  the  crews  of  two  or  more  helicopters,  a 
helicopter  crew  and  division  artillery  personnel,  a  helicopter  crew  and 
a  forward  air  controller,  a  helicopter  crew  and  the  crew  of  a  close  air 
support  aircraft,  a  helicopter  crew  and  air  traffic  control  personnel,  a 
helicopter  crew  and  a  ground-unit  commander  at  almost  any  level  of 
command,  and  so  on.  There  is  considerable  concern  in  the  Army  that  the 
effectiveness  of  combat  operations  may  be  compromised  by  the  lack  of 
training  on  team  tasks. 

This  subsection  addresses  the  need  for  research  to  (a)  determine 
the  specific  requirements  for  team/combined-arma  training  within  Army 
aviation,  and  (b)  specify  the  role  of  flight  simulators  in  providing 
such  training. 


Background 
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In  1976,  the  Defense  Science  Board  acknowledged  the  need  for 
greater  emphasis  on  the  training  of  crews,  groups,  teams,  and  units 
throughout  all  branches  of  the  armed  services  (Defense  Science  Board, 
1976).  The  Defense  Science  board  also  acknowledged  that  the  accomplish¬ 
ment  of  this  objective  will  require  extensive  research  on  the  nature  of 
team  performance,  the  methods  for  defining  and  measuring  taam  perfor¬ 
mance,  the  methods  for  defining  team  training  requirements,  and  the 
methods  and  devices  that  will  yield  effective  team  training.  The 
Defense  Science  Board's  reconsaendatlons  are  based  on  the  fundamental 
premises  that  training  on  individual  skills  alone  is  inadequate  to  meet 
the  requirements  of  peacetime  readiness  and  wartime  deployment,  and  that 
there  are  some  essential  skill  elements— above  and  beyond  individual 
skills— that  can  be  acquired  only  through  training  and  practice  as  a 
team.  There  is  some  research  evidence  that  supports  these  premises  (see 
references  cited  in  the  following  paragraph).  Moreover,  the  belief  in 
the  necessity  of  team  training  is  reflected  in  both  past  and  present 
military  training  practlcesj  military  training  nearly  always  culminates 


in  some  form  of  multi-individual  or  team  training. 

Since  the  Defense  Science  Board  published  their  recommendations, 
several  Department  of  Defense  agencies  have  funded  efforts  to  review  the 
teom-tralning  literature  and  to  identify  research  that  will  eventually 
lead  to  Improved  team-training  principles  and  practices  (Denson,  1981; 
Dyer,  Tremble,  &  Finley,  1980;  Prophet,  Shelnutt,  A  Spears,  1981; 
Thorndyke  &  Weiner,  1980;  Wagner,  Hibblts,  Rosenblatt,  &  Schulz,  1977). 
These  documents  and  others  have  been  reviewed  in  an  attempt  to  extract 
general  observations  and  conclusions  that  have  a  bearing  on  Army  aviator 
team  training  snd  the  potential  role  of  flight  simulators  in  accom¬ 
plishing  this  training.  The  conclusions  considered  relevant  are 
summarized  below. 
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Valua  of  prior  raaaarch.  The  Ceam-tralnlng  research  literature  is 
neither  extensive  nor  current,  and  no  research  was  located  that  deals 
directly  with  the  team  training  of  Army  aviators.  Although  some  of  the 
prior  research  is  of  eonsldernble  theoretical  interest,  the  results  are 
of  marginal  value  in  answering  specific  questions  about  the  types  of 
team  skills  that  Army  aviators  must  possess  in  order  to  perform 
effectively  in  combat  or  the  best  way  to  train  such  skills.  Hence, 
there  is  a  definite  need  for  further  research  in  this  area. 

Definition  of  a  team.  The  definition  of  what  constitutes  a  team 
and  the  specification  of  the  attributes  that  differentiate  a  team  from  a 
small  group  has  received  considerable  attention.  Thorough  discussions 
of  various  definitions  of  a  team  are  presented  by  Denson  (1981),  Hall 
and  Rizzo  (1975),  Melster  (1976),  and  Wagner  ec  al.  (1977).  Researchers 
differ  in  their  conceptual  definition  of  a  team,  and  those  who  have 
reviewed  these  definitions  generally  agree  that  there  is  no  definition 
that  is  suitable  for  all  circumstances.  Even  so,  there  seems  to  be  a 
general  consensus  that  the  minimum  characteristics  for  a  team  Include; 

a  a  goal  or  mission  orientation, 

e  a  formal  structure, 

e  assigned  roles,  and 

e  a  requirement  for  interaction  between  members  (Hall  &  Rizzo, 
1975). 

Other  factors  that  may  prove  Important  in  deriving  a  suitable 
definition  of  a  team  include  number  of  individuals,  degree  of  Intsrac- 
tlon/communicatlon,  physical  proximity  during  team  activity,  and  the 
Interrelationship  among  equipment  under  the  control  of  individuals.' 

It  should  be  noted  that  most  of  the  contemporary  definitions  of  a 
team  were  derived  from  definitions  originally  formulated  by  individuals 
working  at  the  American  Institutes  for  Research  Team  Training  Laboratory 
(see  Klaus  &  Glaser,  1968). 

Established  vs.  emergent  situations.  A  point  on  which  there  is 
uniform  agreement  Is  that  cha  context  in  which  team  behavior  occurs  has 
a  major  impact  on  the  type  of  team  training  that  Is  appropriate  and 
beneficial.  This  context  is  viewed  as  a  continuum  that  varies  from  a 
totally  "established"  situation  to  a  totally  "emergent"  situation. 
Boguslaw  and  Rprter  (1962)  describe  these  situations  in  the  following 
mi.nner. 

■  Established  Situation — one  in  which  (a)  all  action-relevant 
environmental  conditions  are  specifiable  and  predictable,  (b) 
all  action-relevant  rtates  of  the  system  are  specifiable  and 
predictable,  and  (c)  available  research  technology  or  records 
are  adequate  to  provide  statements  about  the  probable 
consequences  of  alternative  actions. 


•  Emergent  Situation— one  in  which  (a)  .  all  action-relevant 
environmental  conditions  have  not  bean  specified,  (b)  the  state 
of  the  system  does  not  correspond  to  relled-upon  predictions, 
and  (c)  analytic  solutions  are  not  available,  given  the  current 
state  of  analytic  technology. 

In  principle,  team  performance  in  a  purely  established  situation 
Is  solely  a  function  of  the  Individual  skills  of  the  team  members;  team 
training  would  not  be  expected  to  benefit  team  performanct  in  a  purely 
established  situation.  Conversely,  team  performance  in  a  purely 
emergent  situation  Is  a  function  of  both  individual  skills  and  team 
skills;  the  maximum  benefits  achievable  from  team  training  would  be 
expected  in  a  purely  emergent  situation.  No  team  function  that  an  Army 
aviator  may  be  required  to  perform  ia  likely  to  be  purely  established  or 
purely  emergent.  Nevertheless,  an  examination  of  where  a  team  function 
lies  along  the  established/emergent  continuum  should  bo  useful  in 
estimating  the  relative  benefito  likely  to  be  realized  from  team 
training  on  that  function. 

Immediate  vs.  extended  teams.  Melster  (1976)  has  made  a  distinc¬ 
tion  between  "immediate"  teams  and  "extended"  teams  that  is  useful  in 
characterising  the  teams  in  which  Army  aviators  may  bo  members.  The 
fundamental  concept  is  that  "immediate"  teams  are  relatively  small  teams 
that  are  embedded  in  larger  "extended"  teams.  The  Army's  AirLand  Battlo 
doctrine  (sec  U,S.  Army  FM  100-5,  1982)  defines  a  hierarchy  of  teams 
chat  will  function  on  Che  modern  battlefield;  helicopter  crews  and 
multi-helicopter  teams  are  embedded  in  "extended"  teams  at  nearly  every 
level  of  the  hierarchy. 

Importance  of  individual  proficiency.  It  is  clear  from  the  team 
training  research  litarature  that  Individual  proficiency  is  a  prerequi¬ 
site  for  effective  team  training,  regardless  of  whether  the  team  is 
operating  in  a  predominately  established  situation  or  a  predominately 
emergent  situation  (Kanarlck,  Alden,  &  Daniels,  1971;  Klaus  &  Glaser, 
1968;  Wagner  et  al.,  1977).  Moreover,  Horrocks  and  his  colleagues  have 
shown  that  an  emphasis  on  coordination  early  in  training  actually 
interferes  with  the  acquisition  of  individual  proficiency  (Horrocks, 
Krug,  and  Hue rtiiatm ,  1960;  Horrocks,  Heermann,  4  Krug,  1961).  In  short, 
it  can  be  cnticludud  that  (a)  team  members  should  be  highly  trained  on 
their  individual  tasks  prior  to  the  onset  of  team  training,  and  (b)  team 
training  should  not  be  used  as  a  means  to  eliminate  individual  skill 
deficiencies.  It  follows  that,  when  Identifying  roquirementa  for  team 
training,  extreme  care  should  be  taken  to  determine  whether  deficiencies 
in  the  performance  of  a  team  ace  the  result  of  Individual  skill 
deficiencies  or  team  skill  deficiencies. 

Definition  of  team  skills.  There  has  been  little  progress  made  in 
defining  what  skills  are  acquired  from  team  training  that  exceed  Che 
composite  skills  of  the  team  members.  Melster  (1976)  states  that  it  is 
this  difficulty  that  accounts  for  the  fact  that  teamwork  is  not  often 
taught  in  terms  of  skills  and  behaviors,  but  by  providing  a  context 


within  which  the  individual  practices  with  others.  The  terns  most 
commonly  cited  in  defining  team  skills  Include:  cooperation,  coordina¬ 
tion,  cohesion,  team  awareness,  interaction,  and  communication. 
Federman  and  Siegel  (1965),  among  others,  have  acknowledged  that  these 
terms  are  highly  ambiguous  and  difficult  to  define  operationally. 

The  authors  of  the  present  report  have  reviewed  the  various 
definitions  of  team  skills  and  have  compiled  a  listing  of  the  specific 
knowledge  and  skill  elements  referred  to  in  the  definitions.  This 
compilation  was  derived  from  the  works  of  Alexander  and  Cooperband 
(1965);  Buguslaw  and  Porter  (1962);  Collins  (1977);  Hood,  Krumm, 
O'Sullivan,  Buckout,  Cane,  Cotterman,  and  Rockway  (1960);  Kanarick  et 
al.  (1971);  and  McRae  0966).  The  specific  team  knowledge  and  skill 
elements  Identified  are  as  follows: 

e  knowledge  of  strengths  and  weaknesses  of  team  members; 

a  knowledge  of  when  other  team  members  want/naed  help; 

e  ability  to  pace  one's  actions  to  fit  the  needs  of  all; 

e  ability  to  behave  in  an  unambiguous  manner; 

•  ability  to  synchronise  actions  with  others,  within  s  time  schema 
or  cycle; 

e  ability  to  participate  effectively  in  solving  problems  for  which 
a  stock  answsr  is  not  availabls  to  the  taam; 

e  inclination  to  cooperate; 

e  knowledge  of  team's  goals; 

s  knowledge  of  the  purpose  and  organlssclon  of  the  total  system; 

e  knowledge  of  the  relationship  of  one's  task  to  the  tasks  of  each 
team  member; 

e  understanding  of  the  characteristics  and  functioning  of  the 
environment  and  the  relative  Importance  of  various  events; 

e  ability  to  be  innovative  in  better  organizing  team  activities; 

•  knowledge  of  communication  mode  that  Is  best  for  the  task  at 
hand; 

a  ability  to  differentiate  between  relevant  and  non-relevant 
communication; 

e  knowledge  of  best  communication  atructure  and  pattern; 

e  knowledge  of  relevant,  unambiguous  vocabulary; 

a  ability  to  recognize  one's  own  errors  so  as  to  Initiate 
corrective  actions; 

•  ability  to  recognize  existing  or  imminent  overload  of  self  and 
other  team  members;  and 


•  knowledge  of  methods  for  adjusting  to  overloads  and  contin¬ 
gencies.  such  as:  cueing,  the  omission  of  some  inputs, 

permitting  certain  errors,  filtering,  approximation,  increasing 
the  work  flow  channels,  chunking  information,  or  abandoning  a 
hopeless  situation. 

Parfonnanca  feadback  and  performance  assessment.  There  is  no 
question  that  perfortnance  feedback  is  as  essential  for  effective  team 
training  as  it  Is  for  effective  individual  training.  As  a  result  of  a 
review  of  the  literature  on  performance  feedback,  Kanarick  ec  al.  (1971) 
conclude  that  "performance  feedback  is  unquestionably  the  single  most 
critical  parameter  in  team  or  individual  training."  Performance  feed¬ 
back  has  been  investigated  as  an  independent  variable  in  several  team 
training  studies  (see  reviews  by  Denson  [1981]  and  by  Wagner  eC  al. 

[  1977  ]).  Of  the  conclusions  drawn  from  these  studies,  the  ones  most 
relevant  to  the  present  effort  are  (a)  team  performance  improves  mure 
rapidly  with  performance  feedback,  (b)  feedback  only  on  the  performance 
of  the  team  as  a  whole  is  generally  effective,  but,  in  some  circum¬ 
stances,  may  foster  inappropriate  responses  that  result  in  a  decrement 
in  team  performance,  and  (c)  performance  feedback  on  both  individual  and 
team  performance  is  generally  more  effective  than  feedback  on  only  one 
or  the  other. 

Although  the  value  of  performance  feedback  is  well  established, 
there  are  many  problems  and  uncertainties  associated  with  providing 
optimal  feedback  for  military  teams,  especially  military  teams  being 
field  trained  In  an  emergent  situation.  Performance  measurement  is 
clearly  the  most  critical  problem.  Effective  performance  feedback  is 
not  possible  without  valid  and  accurate  measures  of  both  individual  and 
team  performance.  And  yet,  relatively  little  is  known  about  the 
definition  of  team  performance  objectives,  the  establishment  of  team 
performance  standards,  and  the  selection  and  weighting  of  team  perfor¬ 
mance  criteria.  The  performance  assessment  problem  is  particularly 
difficult  in  emergent  situations  in  which  two  or  more  acceptable  solu¬ 
tions  to  a  problem  are  possible.  A  second  problem  is  that,  given 
adequate  performance  measures,  little  is  known  about  optimal  methods  for 
conveying  performance  feedback  to  team  members.  Post-flight  debriefings 
and  discussions  Is  the  method  most  commonly  used  at  present.  It  seems 
certain  that  the  technology  presently  available  could  be  exploited  to 
produce  far  more  effective  methods  for  providing  performance  feedback  on 
team  performance.  " 


The  Research  Requirement 

The  immediate  requirement  is  for  research  that  serves  to  clarify 
the  potential  rule  of  flight  simulators  in  training  the  team  skills  Chat 
Army  aviators  must  possess  to  perform  effectively  in  combat.  This 
research  should  provide  data  with  which  to  (a)  assess  the  utility  of 
production  simulators  for  training  team  skills,  and  (b)  specify  the 
types  of  design  modifications  that  would  significantly  increase  the 


effectiveness  of  production  elnulators  for  training  team  skllla. 
Unfortunately,  It  Is  not  possible  to  design  and  conduct  research  that 
meets  the  Immediate  requirement  until  far  more  Is  known  about  the 
composition,  structure,  and  functions  of  the  teams  In  which  Army 
aviators  participate  as  team  members.  In  other  words,  considerable 
preliminary  research  on  team  training  must  be  conducted  before  it  will 
be  possible  to  evaluate  flight  simulators'  role  In  team  training.  It 
should  be  noted,  however,  that  the  results  of  the  preliminary  research 
should  be  of  great  value  to  the  Army,  regardless  of  whether  team 
training  In  flight  simulators  proves  feasible.  Indeed,  the  preliminary 
research,  as  outlined  below,  is  nothing  more  than  is  needed  to  address 
the  team  training  research  Issues  spelled  out  by  the  Defense  Science 
Board  nearly  ten  years  ago  (Defense  Science  Board,  1976). 


An  Overriding  Issue 

A  factor  chat  may  be  more  important  than  any  other  in  determining 
optimal  team  training  methods  is  Che  turnover  in  team  membership  that 
can  be  expected  in  a  combat  sicuaClon.  If  teams  that  are  trained 
together  can  be  expected  to  fight  together  in  combat,  it  may  be 
practical  to  provide  the  type  of  training  that  enables  team  members  to 
tailor  operating  procedures  and  communication  techniques  to  the  unique 
skills,  abilities,  and  personality  traits  of  the  team  members.  However, 
If  Che  personnel  that  comprise  a  team  can  be  expected  Co  change 
frequently  because  of  combat  casualties  or  scheduling  expediencies, 
training  that  results  in  team-specific  operating  procedures  and 
communication  techniques  would  be  ineffective  and  probably  counter¬ 
productive.  A  high  or  even  moderate  rate  of  turnover  in  team  membership 
during  combat  dictates  that  personnel  be  trained  to  function  in  a  team 
context  rather  chan  be  trained  to  function  as  a  member  uf  a  specific 
team.  In  such  situations,  the  main  team  skill  to  be  learned  may  be  the 
capacity  to  accommodate  quickly  to  different  team  members  who  possess 
different  skills,  abllicies,  and  personality  traits.  The  acquisition  of 
such  skill  may  require  a  procedure  whereby  an  Individual  being  trained 
to  occupy  a  given  team  position  is  trained  each  day  with  a  different  set 
of  team  members. 

The  expected  rate  of  turnover  also  has  important  implications  for 
Che  need  to  develop  highly  standardized  operating  procedures  and  a 
standardized  vocabulary;  the  higher  the  rate  of  turnover,  the  greater* 
the  need  for  standardization. 


Research  Approach 

The  following  paragraphs  outline  in  very  general  terras  the  tasks 
that  are  considered  necessary  to  fulfill  the  research  requirement  cited 
above. 


Compile  Inventory  of  teams  and  team  characteristics.  The  purpose 
of  this  task  is  to  compile  a  comprehensive  inventory  of  the  full  range 
of  teams  for  which  an  Army  aviator  may  participate  as  a  team  member i  and 
to  compile  data  on  the  characteristics  of  each  team.  This  task  should 
commence  with  a  careful  review  of  data  compiled  by  Dyer  et  al.  (1980), 
who  recently  conducted  an  Army-wide  survey  to  identify  Army  teams  and  to 
define  their  characteristics.  The  data  compiled  by  Dyer  et  al.  will  be 
augmented,  as  necessary,  with  reviews  of  the  most  current  documents  on 
Army  organization  and  tactical  doctrine,  and  by  interviews  with  selected 
personnel  in  Army  aviation  units.  Although  teams  that  Include  heli¬ 
copter  aviators  are  of  primary  interest,  the  survey  to  identify  teams 
will  encompass  all  types  of  aircraft  and  all  types  of  aviation  units, 
Moreover,  the  survey  will  be  designed  to  Identify  both  "formal"  teams, 
identified  In  the  official  Tables  of  Organization  and  Equipment  (TOE), 
and  "ad  hoc"  teams  that  form  frequently  although  temporarily  on  the 
battlefield. 

For  each  team  identified,  data  will  be  compiled  to  characterize 
Che  function,  structure,  personnel  composition,  operating  procedures, 
and  training  of  the  team. 

Classify  Csama  into  types.  The  objectlva  of  this  task  is  to 
develop  a  scheme  for  clustering  teams  with  similar  attributes,  Although 
the  attributes  to  be  used  In  classifying  teams  cannot  be  fully  specified 
at  this  time,  it  is  probable  that  at  least  the  following  attributes  will 
be  considered!  team  size,  number  of  positions,  ranks  of  team  members, 
team  function,  requirement  for  synchrony  in  team  members'  actions, 
requirement  for  coordination,  command  structure,  role  flexibility, 
location  of  Che  team  on  Che  established/emergent  continuum,  location  of 
the  team  In  Che  combined-arms  team  hierarchy,  expected  turnover  of  team 
members  during  peacetime  readiness  training  and  during  combat,  whether 
Che  team  Is  formal  or  ad  hoc,  and  whether  the  team  Is  an  Immediate  or  an 
extended  team. 

Select  target  teams.  Once  Che  population  of  teams  has  been 
tdentlfifd  a^d  classified  into  team  types,  a  sample  of  target  teams  will 
be  selected  ror  'urther  study.  The  objective  is  to  select  a  small  sot 
of  teams  that,  together,  cover  the  full  range  of  team  types  and  aircraft 
types. 


IdenCify/analyze  team  tasks.  For  each  target  team,  a  mlsslon/task 
analysis  will  be  conducted  to  identify  Che  full  range  of  team  Casks  that 
must  be  performed  by  the  team  and  the  full  range  of  conditions  in  which 
it  may  be  necessary  to  perform  the  team  tasks.  The  results  of  the  task 
analysis  must  identify  task  elements,  the  sequence  In  which  the  task 
elements  must  be  performed  (if  any),  the  team  member  who  is  responsible 
for  performing  the  task  element,  and  the  equipment  that  must  be  employed 
Co  accomplish  Che  task  element. 
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Identify  types/causea  of  team  performance  problema.  A  critical 
atop  In  this  research  Is  to  Identify  the  types  and  causes  of  problema 
Chat  target  teams  encounter  In  performing  team  functions.  The  ultimate 
question  Is:  l^ac  are  Che  problem  cypes/causes  chat  target  teams  are 
likely  Co  encounter  In  combat?  There  are  at  least  three  useful  sources 
of  information  about  team  performance  problems: 

e  Interviews  with  members  of  the  target  teams  and  their  unit 
commanders, 

#  observation  of  team  training  operations,  Including  training 
operations  held  at  the  National  Training  Center,  and 

•  review  of  data  compiled  during  recent  combat  operations,  such  as 
the  Invasion  of  Granada. 

The  results  of  the  mlsslon/cask  analyses  will  be  used  in 
conducting  struct <red  Interviews  with  experienced  aviators.  Aviators 
and  other  ind  viduals  who  comprise  the  team  under  study  will  be 
Instructed  to  review  systematically  the  products  of  the  mlsslon/task 
analyses  and  will  be  questioned  about  (a)  Che  validity  of  Che  analyses, 
(b)  team  parformance  problems  frequently  encountered  and  the  causes  of 
the  problems,  (c)  the  need  for  team  training,  (d)  team  training 
requirements  that  cannot  be  met  given  the  existing  constraints  on 
training,  and  (e)  recommended  solutions  Co  team  performance  problems. 

Ideally,  Che  information  compiled  from  the  aviator  interviews 
would  be  augmented  with  systematic  observations  of  team  training 
operations.  Such  observations  could  be  made  during  routine  unit¬ 
training  operations  and  during  training  operations  conducted  at  the 
National  Training  Center  at  Fort  Irwin,  California.  Finally,  as  oCated 
above,  a  careful  review  of  Che  data  compiled  during  recent  combat 
operations,  such  as  Che  Granada  Invasion,  should  yield  useful  Informa¬ 
tion  about  Che  Cypes/causes  of  team  performance  problems. 

List  problems  caused  by  team  training  deficiencies.  The  purpose 
of  this  task  is  to  list  the  team  performance  problems  that  are  caused, 
wholely  or  In  part,  by  team  training  deficiencies.  It  is  expected  that 
many  of  the  team  performance  problems  commonly  nttributecl  to  team 
training  deficiencies  are,  in  fact,  caused  by  other  factors,  such  as; 
individual  skill  deficiencies,  ineffective  operating  procedures, 
equipment  „  limitations,  and  vague  team  objectives.  Analytic  study, 
follow-up  interviews,  and  perhaps  other  techniques  will  be  used  to 
select,  from  the  total  population  of  team  performance  problema,  those 
that  stem  from  inadequate  team  training. 

Formulate  team  training  objectives.  The  results  of  the  mission/ 
task  analyses  and  the  results  of  the  team  performance  problem  analyses 
will  be  used  to  compile  a  listing  of  specific  team  skills  on  which  Amy 
aviators  must  be  trained  in  order  to  ensure  effective  team  performance. 
In  principle,  the  mlsslon/task  analyses  will  yield  a  comprehensive  list 
of  the  team  skills  that  must  be  acquired  during  training;  the  problem 
analyses  will  yield  the  information  needed  to  order  the  team  skills  In 


Cerms  ot  Che  crlclcallcy  of  Che  skill  and  cha  ralaclve  need  for  addl- 
clonal  ceam  cralnlng  on  ChaC  skill.  All  cralnlng  objecclves  muse  be 
considered  in  evaluaclng  Che  uclllcy  of  fllghC  slnulacors  for  Ceam 
Cralnlng,  buc  Ceam  cralnlng  chat  cannoc  be  conducced  effecclvely  In  Che 
alrcrafC  Is  obviously  of  special  InCeresc. 

Assess  fsaslblllty/beneflcs  of  flight  slmulacor  Cralnlng.  The 
final  Cask— assessing  the  feaslblllcy/beneflcs  of  Ceam  cralnlng  In 
fllghc  slmulacors— is  boch  difficult  and  complex.  To  accomplish  thin 
Cask,  Ic  will  be  necessary  co  compile  data  wlch  which  to  answer  Che 
following  questions: 

•  Whac  Ceam  cralnlng  can  be  accomplished  using  a  single  producClon 
slmulacor? 

•  In  whac  ways  can  a  producClon  simulator  be  modified  to  increase 
its  effectiveness  for  taam  Cralnlng?  Is  IC  likely  that  Che 
Cralnlng  benefits  realized  from  the  modifications  will  offset 
their  coat? 

a  Can  Ceam  skills  be  taught  Co  an  Individual  Ceam  member  using 
"surrogate"  Ceam  members  (InscrucClonal  personnel  or  a 
computer) ? 

•  I*?hac  team  cralnlng  can  be  accomplished  In  an  Integrated  set  of 
cwo  or  more  production  slmulacors  chat  cannot  be  accomplished  by 
using  the  simulators  Independently? 

•  In  what  ways  can  an  integrated  set  of  producclon  simulators  be 
modified  Co  Increase  training  effectiveness?  Is  it  likely  Chat 
Cho  benefits  realized  from  the  modifications  will  offset  their 
cost? 

Answers  to  the  above  questions  should  Initially  be  sought  through 
analytic  study.  A  team  composed  of  SMEs  In  the  fields  of  training 
technology,  flight  simulator  design,  and  military  operations  and  tactics 
should  be  able  to  identify  the  Ceam  training  that  clearly  cannot  be 

accomplished  in  each  of  the  simulator  configurations  listed  above.  That 
is,  knowledge  of  the  team  task  requirements  and  knowledge  of  the  design 
capabilities  the  s iinu.l.a tors  (production  and  modified)  should  enable  Che 
SMEs  Co  accurately  judg(2  when  a  team  task  simply  cannot  be  simulated 

wlch  reasonable  fidelity.  However,  given  that  a  team  task  can  be 
simulated,  SHE  Judgments  are  not  adequate  Co  assess  Ct^,e  benefits  of 
simulator  training  on  Chat  task;  empirical  research  will  be  required  to 
assess  the  cost  effectiveness  of  simulator  training  on  that  team  task. 

A  judicial  decision  about  whether  or  not  to  embark  on  an  extensive 
program  of  research  to  assess  the  cost/training  effectiveness  of  team 
training  in  flight  simulators  must  be  based  on  (a)  the  type  and  number 
of  team  tasks  that  SMEs  judge  can  be  simulated,  (b)  the  estimated 

benefits  of  die  cralning.  and  (c)  the  estimated  cost  of  the  training, 

including  the  cost  of  any  simulator  modifications  considered  necessary. 
Even  with  the  best  of  analytical  data,  such  a  decision  will  be  difficult 
Co  m.ike. 


PERFORMANCE  EVALUATION 


the  literacure  is  replete  with  reports  and  articles  that  acknowl¬ 
edge  that  performance  measurement  Is  a  major  problem  for  both  research 
on  aviator  training  systems  and  on  conduct  of  the  training  Itself.  Con¬ 
temporary  experts  In  performance  measurement  seem  to  agree  on  two 
Important  points.  First,  they  agree  that  automated  performance  measure¬ 
ment  systems  In  both  simulators  and  training  aircraft  represent  the 
ideal  solution  to  the  performance  measurement  problem.  Second,  they 
agree  that  the  performance  measures  that  the  automated  systems  produce 
must  be  derived  empirically  by: 

e  defining  an  initial  sec  of  potentially  useful  measures, 

e  collecting  performance  data  using  groups  of  aviators,  with  known 
differences  in  flying  proficiency  for  the  task^s)  in  question, 

e  using  multivariate  statistical  techniques  Co  select  Che 
smallest,  weighted  combination  of  measures  that  does  a  good  Job 
in  differentiating  among  the  differently  skilled  groups,  and 

•  validate  the  measures. 

The  methods  and  computer  programs  used  to  derive  performance 
measures  are  available  now,  but  they  have  been  applied  In  only  a  few 
instances.  The  studies  reported  In  Che  literature  have  investigated 
only  a  few  flying  tasks — all  in  fixed-wing  aircraft.  Furthermore,  the 
tasks  investigated  Co  date  have  been  ones  in  which  it  Is  relatively  easy 
Co  define  Che  command  position  and  attitude  of  Che  aircraft  throughout 
the  task  (maneuver)  and,  therefore,  relatively  easy  to  define  and 
measure  performance  error  (carrier  landings  and  Instrument  Landing 
System  (ILS)  approaches  are  examples). 

Nixon  and  Moroney  (1982)  reviewed  literature  published  between 
1962  and  1981  to  compile  an  Inventory  of  the  performance  measures  chat 
have  been  used  In  research  on  air  systems  and  aviator  training  systems. 
They  compiled  a  list  of  182  different  performance  measures  that  have 
been  used  In  one  or  more  research  efforts.  The  state-of-the-art  does 
not  enable  experts  to  Identify  the  me.asures  on  this  list  that  are  needed 
to  assess  proficiency  on  a  given  task  or  the  differential  weights  that 
should  be  assigned  to  each  measure,  and  it  will  be  nectissary  to  complete 
a  monumental  amount  of  research  In  order  to  specify  the  types  and 
weights  of  measures  that  provide  the  best  index  of  proficiency  on  a 
given  task.  Herein  lies  Che  problem.  Sensitive  and  valid  performance 
measures  are  required  to  accomplish  research  on  tho  design  anu  use  of 
Che  Army's  flight  simulators,  and  yet,  this  research  simply  cannot  await 
the  development  of  effective  automated  performance  measurement  systems 
for  simulators  and  aircraft. 

Long-term  research  goals  should  be  established  to  conduct  the 
basic  research  needed  to  develop  automated  performance  systems,  but.  the 
short-term  research  on  performance  measures  sliould  he  aimed  at  making 
better  use  of  SMEs  in  assessing  flying  proficiency.  Tliere  is  ample 
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evidence  that  SMEa  are  capable  of  assessing  flying  proficiency ,  but 
there  are  no  data  to  use  In  estimating  Just  how  reliable  and  valid  SKE 
ratings  can  be  if  they  are  (a)  given  extensive  training  on  performance 
assessment!  (b)  provided  with  clear-cut  performance  criteria  and 
standards,  and  (c)  provided  with  continuous  records  of  aircraft 
positions  and  attitude  throughout  the  task  or  maneuver  being  conducted. 


ALTERNATE  TRAINING  DEVICES/METHODS 

In  the  past,  alternate  training  devices  have  not  received  the 
attention  they  deserve.  Too  often,  flight  simulators  have  been  designed 
to  provide  training  on  the  greatest  number  of  flying  tasks  that  la 
technically  feasible;  the  tendency  has  been  to  consider  the  use  of 
alternate  training  devices  only  when  It  Is  found  chat  a  given  training 
requirement  simply  cannot  be  met  In  Che  simulator.  When  the  training 
capability  of  a  flight  simulator  Is  forced  In  this  manner,  Che  likely 
result  Is  Chat  simulator  training  on  some  Casks  will  be  Ineffective 
relative  to  training  In  an  alternate  device  designed  specifically  to 
provide  training  on  one  or  a  small  number  of  Casks. 

The  net  result  of  the  emphasis  placed  on  large,  all-purpose  flight 
simulators  Is  that  little  effort  has  been  expended  in  attempting  to 
define  the  tasks  chat  might  better  be  trained  in  alternate  devices  and 
attempting  to  apply  the  most  current  technology  in  designing  alternate 
devices.  It  Is  for  this  reason  that  a  recommendation  is  made  to 
establish  a  research  area  that  focuses  on  alternate  training  devices. 
The  broad  objective  of  this  research  area  is  to  design  and  conduct 
research  aimed  at  (a)  Identifying  potentially  effective  applications  of 
alternate  training  devices,  and  (b)  developing  potentially  effective 
design  concepts  for  alternate  training  devices, 

Another  objective  of  this  research  area  Is  to  provide  estimates  of 
Che  cost  and  training  effectiveness  of  alternate  training  devices.  As 
has  been  stated  previously,  the  cost  effectiveness  of  training  in  a 
flight  simulator  cannot  be  evaluated  fully  without  considering  the  cost 
and  training  effectiveness  of  alternate  devices.  Although  essential  for 
the  success  of  thi.s  program,  the  task  of  estimating  Che  cost  and 
training  effectiveness  of  alternate  training  devices  is  a  difficult  one. 
Such  estimates  are  particularly  difficult  when  the  alternate  training 
device  being  considered  Is  one  that  has  not  yet  been  developed  and 
tested.  In  such  cases,  the  only  apparent  ways  to  formulate  cost-  and 
training-effectiveness  estimates  are  to  depend  upon  the  Judgment  of  SMEs 
or  to  construct  a  prototype  device  and  test  it.  The  first  approach  Is 
subject  to  large  errors  and  the  second  is  both  costly  and  time 
consuming.  So,  a  second  important  objective  of  this  research  area  Is  to 
design  and  conduct  the  research  needed  to  develop  more  effective  methods 
for  estimating  the  cost  and  training  effectiveness  of  alternate  training 
devices  prior  to  their  development  and  empirical  evaluation. 


SUBSYSTEM  STANDARDIZATION/MODULARIZATION 

There  are  many  ways  to  achieve  cost  savings  in  the  design  of 
flight  simulators.  For  the  moat  part,  this  research  program  la  aimed  at 
achieving  cost  savings  by  Identifying  and  eliminating  unnecessary 
fidelity  in  simulator  components.  A  complementary  approach  to  cost 
savings  is  the  modularization  end  standardization  of  hardware  and 
software  components  that  are  common  to  all  or  most  flight  simulators. 

At  present,  the  design  coate  of  many  types  of  hardware  and 
software  are  being  reduced  by  utilizing,  when  possible,  standardized 
components  that  are  readily  available  on  the  market.  It  seems  probable 
that  similarly  great  savings  can  be  realized  if  standardized  components 
are  developed  and  used  in  producing  new  flight  simulators.  This  would 
require  that  effort  be  expended  in  subdividing  a  flight  simulator  into 
functional  modules  and  in  designing  standardized  modules  that  could  be 
used  as  building  blocks  in  developing  new  flight  simulator  systems. 
Examples  of  flight  simulator  components  that  might  be  designed  as 
standardized  modules  Includes  computers,  power  systems,  motion  systems, 
external  visual  displays,  cockpit  superstructure,  selected  cockpit 
displays,  aerodynamic  modules,  and  instructional  support  features. 

Use  of  standardized  modules  in  producing  new  flight  simulators  has 
Che  potential  for  reducing  both  the  cost  of  Initial  development  and  the 
cost  of  operational  support.  Moreover,  the  standardization  of  interface 
connectors,  signal  communication  protocols,  and  certain  physical 
attributes  of  modules  would  facilitate  the  flight  simulator  modifica¬ 
tions  needed  to  track  modifications  of  the  operational  aircraft. 


RESEARCH  METHODOLOGY 

The  discussion  of  the  long-term  research  plan  frequently  points  to 
the  need  for  improved  research  methodology.  This  subsection  consoli¬ 
dates  and,  in  some  cases,  expands  on  earlier  comments  about  the  need  for 
more  efficient  and  more  effective  research  methodology. 


Alternatives  to  Transfer-of-Trainlng  Methodology 

The  requirement  for  more  efficient  research  methodology  stems 
mainly  from  the  fact  that  transfer-of-trainlng  research  is  often  too 
costly,  too  time  consuming,  and  too  difficult  (administratively)  to 
justify  its  use.  This  is  particularly  true  when  research  is  required  to 
evaluate  hardware  design  options,  instructional  design  options,  or  both. 
When  the  number  of  options  to  be  considered  is  large— as  is  the  case 
with  the  research  proposed  in  the  long-term  research  plan  it  may  be 
prohibitively  expensive  to  evaluate  every  option  using  a  series  of 
transfer-of-tralning  experiments.  And  yet,  proven  alternative  method- 
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As  a  consequence,  there  is  an  urgent  need  Cor  the  Array  to  initiate 
an  effort  aimed  at  developing  and  validating  more  efficient  method¬ 
ologies  designed  specifically  to  reduce  design  options  to  a  number  that 
can  be  evaluated  with  tranafer-of-tralnlng  research  without  the  expendi¬ 
ture  of  excessive,  resources.  It  la  luportant  to  emphasize  that  it  is 
not  being  suggested  that  tneChodologies  can  be  developed  chat  would 
eliminate  the  ultimate  need  to  conduct  transfer-of-trainlng  research  to 
assess  the  cost  effectiveness  of  one  or  more  alternative  devices/ 
methods.  Rather,  it  is  being  suggested  Chat  more  efficient  method¬ 
ologies  can  be  developed  chat  would  enable  researchers  to  make  valid 
Judgments  about  which  design  options  should  be  included  in  the  transfer- 
of-trainlng  research. 

Liated  below  are  alternative  methodologies  Chat  have  been 
mentioned  in  other  subsections  of  the  long-term  research  plan  or  else¬ 
where  (see,  for  example:  Caro  (1977b];  Caro,  Shelnutc,  &  Spears  (1981]; 
and  Hays  &  Singer  [1983]).  This  list  is  meant  to  be  Illustrative  rather 
Chan  comprehensive. 

e  Devlce-co-device  transfer— using  aviator  trainees  as  aubjacta, 
measura  training  transfer  from  the  device/condition  under 
InvesClgatlon  to  a  devica/condlcion  in  which  training  la  known 
to  transfer  to  the  aircraft. 

a  Backward  transfer— using  experienced  avlntors  as  subjects, 
measure  the  relationship  between  performance  in  the  aircraft  and 
performance  in  the  device  under  investigation. 

e  Similarity  of  response  characteristics/strateglea— using  experi¬ 
enced  aviators  as  subjects,  compare  response  characteristics/ 
atracegiea  in  Che  device  under  Investigation  with  Che  response 
characterlatics/stratcgies  in  Che  aircraft. 

a  Skill  acquisition  In  device — using  aviator  trainees  as  subjecta, 
measure  the  rate  and  amount  of  skill  acquisition  chat  occurs  as 
a  function  of  training/practice  in  the  device  under 
investigation. 

Caro  (1977b)  and  Hays  and  Singer  (1983)  have  discussed  the  short¬ 
comings  of  the  above  methodologies  and  others  as  well.  They  share  the 

view  that  the  above  methodologies  have  low  validity  when  used  as  the 

sole  means  for  evaluating  the  training  effectiveness  of  a  device. 
However,  the  risk  associated  with  the  above  methodologies,  or  any  other, 
dependa  upon  how  the  resultant  data  are  interpreted.  There  is  no 
question  that  the  risk  of  drawing  invalid  conclusions  is  excessive  if 
data  indicating  "good"  performance  (high  rate  of  skill  acquisition,  high 
level  of  backward  transfer,  etc.)  in  a  training  device  Is  taken  as  proof 
of  the  device's  training  effectiveness.  For  Instance,  evidence  of  skill 
acquisition  in  a  flight  simulator  does  not  necessarily  mean  Chat  Che 

aviator  trainee  is  acquiring  skills  that  will  transfer  positively  to  the 

aircraft.  On  the  other  hand,  the  risk  of  dr.nwlng  Invalid  conclusions  is 
much  lower  if  data  indicating  "poor"  performance  is  taken  as  evidence 
that  the  devi.,'  lacks  training  effectlvcnes.i,  cither  because  of  the 


device's  design  or  because  of  Che  manner  In  which  It  was  used.  For 
Instance,  if  performance  in  a  flight  simulator  falls  to  Improve  signifi¬ 
cantly  with  practice,  it  la  difficult  to  Imagine  that  the  trainee  is 
acquiring  skills  chat  would  transfer  positively  to  Che  aircraft. 

An  effort  to  develop  Improved  methodologies  should  commence  with  a 
literature  review  and  a  survey  of  SMEs  to  Identify  potentially  useful 
methodologies.  Then,  empirical  research  should  be  conducted  to  deter¬ 
mine  the  validity  of  Che  mechodologles  for  various  uses— particularly 
for  use  in  the  preliminary  screening  of  options  for  training  devices  and 
training  methods. 


Improved  Tranefer-of-Tralnlng  Research  Designs 

Regardless  of  the  types  of  research  that  are  conducted  In 
designing  a  flight  simulator,  final  decisions  about  the  relative  and 
absolute  utility  of  alternative  designs  must  be  based  on  their  cost 
effectiveness.  As  Is  well  known,  cost  ef fsctlveness  Is  a  function  of 
(a)  the  costs  of  training  In  the  simulator  and  the  aircraft,  and  (b)  the 
extent  to  which  simulator  training  transfers  to  tha  aircraft.  This 
subsection  Is  focused  on  research  designs  that  yield  the  requisite 
transfer-of-tralnlng  data. 

The  design  of  a  eransfer-of-tralning  study  la  a  simple  matter  if 
Che  Intent  Is  merely  to  measure  training  transfer  from  a  prescribed 
slmulaCor-trelnlng  curricula  to  the  aircraft.  However,  the  classical 
transfer-of-tralnlng  paradigm  (see  Appendix  E)  is  appropriate  only  when 
Che  slmulatoc-tralnlng  curricula  Is  known  to  bs  near  optimal.  This  Is 
seldom  the  case.  When  designing  transfsr-of-Cralnlng  research  to 
evaluate  new  simulator  designs,  a  researcher  cannot  be  expected  to 
poeeees  the  Information  needed  to  develop  curricula  that  Cakes  full 
advantage  of  Che  simulator  characteristics.  The  researcher  cannot 
ignore  the  problem  because  a  poorly  designed  training  curricula  can 
degrade  training  transfer  to  such  an  extent  Chat  even  major  differences 
in  the  training  effectiveness  of  alternate  designs  would  be  masked. 
Furthermore,  estimates  of  cost  savings  resulting  from  8imul.ator  training 
would  be  totally  invalid  if  an  ineffective  curricula  were  employed. 

So,  when  designing  research  to  assess  the  transfer-of-tralnlng  of 
o'he  or  more  new  simulator  designs,  Che  researcher  is  forced  to  consider 
such  questions  as! 

e  What  tasks  roust  be  trained  In  the  simulator? 

e  In  what  sequence  should  the  Casks  be  trained? 

•  How  much  and  what  type  of  training  should  be  given  for  each 
task? 

e  Should  all  simulator  training  be  completed  before  the  trainee 
receives  any  training  in  the  aircraft,  or  should  simulator 
training  and  aircraft  training  be  alternated?  If  simulator/ 


aircraft  alternation  la  beneflclali  what  la  the  beat  alternation 
achedule? 

•  What  la  the  optimal  way  to  use  the  simulator  when  there  is 
insufficient  time  during  the  training  day  to  provide  every 
trainee  with  an  optimal  amount  of  training  on  every  task? 

The  above  questions  must  bo  considered  for  each  type  of  training  that 
may  be  conducted  in  the  simulator:  initial  acquisition  of  flying 
sklllsi  maintenance  of  flying  aklllst  and  relearning  of  flying  skills. 

It  can  bo  argued  that  the  above  mentioned  questions  should  be 
answered  through  a  series  of  analytic  or  transfer-of-training  studies 
prior  to  conducting  a  tranafer-of-trainlng  study  to  make  a  final 
assessment  of  the  simulator's  cost  effectiveness.  Howevert  it  can  also 
be  argued  that  more  sophisticated  transfer-of-training  designs  can  be 
developed  that  would  provide  the  data  needed  to  develop  predictive 
models.  These  models •  in  turn,  could  be  used  to  predict  coat  and 
training  effectiveness  for  a  variety  of  training  curricula.  The  Army 
has  made  some  progress  in  developing  this  type  of  training-device 
evaluation  methodology  (Blckley,  1980a).  However,  there  is  a  pressing 
need  for  the  Army  to  expand  upon  this  work. 

Before  concluding  this  subsection,  it  is  important  to  emphasize 
the  nead  to  develop  research  methodologios  for  assessing  the  utility  of 
simulators  for  maintaining  flying  skills  (continuation  training).  The 
bulk  of  Army  flight  time  is  devoted  to  skill  maintenance  rather  than 
initial  skill  acquisition,  so  the  use  of  simulators  for  continuation 
training  has  the  potential  for  yielding  great  savings.  And  yet,  little 
effort  has  been  expended  by  the  Army  to  develop  effective  research 
designs  for  assessing  the  cost  Effectiveness  of  simulators  used  for 
continuation  training. 


SKILL  DECAY /MAINTENANCE 

Along  with  all  other  DoD  agencies,  the  Army  is  faced  with  two 
competing  objectives:  maintain  combat  readiness  and  minimize  operating 
costs.  In  Army  aviation,  the  problem  is  acute  in  that  individual  combat 
readiness  is  presently  being  muintained  through  a  program  of  "continua¬ 
tion"  flight  training  conducted  in  aircraft  that  h:^ve  unavoidably  high 
operating  costs. 

The  bulk  of  Army  flight  time  is  devoted  not  to  initial  acquisition 
of  flying  skills  but  to  the  maintenance  of  these  skills.  As  a  conse¬ 
quence,  the  use  of  flight  simulators  for  maintaining  the  individual 
flying  skills  of  unit  aviators  promises  to  yield  substantial  dividends. 
The  potential  dividends  of  incorporating  simulator  training  into  the 
Army's  continuation  training  program  are  of  three  types: 

•  reducing  total  training  costs  by  replacing  aircraft  training 
hours  with  simulator  training  hours, 


•  Increasing  Individual  skills  by  enabling  unit  commanders  co 
allocate  the  flying  hours  saved  by  simulator  use  to  training  on 
Individual  flying  skills  that  are  better  trained  and  maintained 
in  the  aircraft,  and 

e  increasing  overall  unit  readiness  by  enabling  unit  conunanders  to 
allocate  the  flying  hours  saved  by  simulator  use  to  training  on 
requisite  combat  akllla,  such  as  taam  operations,  that  presently 
are  deficient  or  are  not  addressed  in  the  program. 

If  training  managers  are  to  make  Judicious  decisions  about  the  use 
of  simulators  for  continuation  training,  they  must  have  a  clear 
knowledge  of  (a)  the  rata  at  which  Individual  flying  skills  decay  when 
not  practiced,  and  (b)  Che  amount  and  type  of  training  required  to 
prevent  skill  decay  or  to  refresh  skills  Chat  have  been  permitted  to 
decay.  Although  a  substantial  amount  of  research  on  skill  decay  and 
maintenance  is  reported  in  the  psychological  literature,  the  tasks 
invsstlgated  are  not  sufficiently  germane  to  helicopter  flying  tasks  to 
enable  training  managers  to  use  the  data  to  establish  a  continuation 
training  program  that  makes  optimal  use  of  a  simulator.  This  subsaction 
argues  the  need  for  the  Army  to  establish  a  research  program  to 
eliminate  this  critically  important  knowledge  deficiency. 


Skill  Decay 

There  is  a  consensus  among  aviators  that  flying  skills  decay,  but 
which  skills  decay  and  the  course  of  Chat  decay  remain  open  questions. 
In  an  extensive  review  of  research  conducted  in  the  general  area  of 
flight  skill  retention,  Prophet  (1976)  concluded  that,  in  general,  basic 
psychomotor  flight  skills  show  little  if  any  decrement  over  extensive 
periods  of  nonflying.  However,  flight  tasks  with  a  significant 
procedural  component  (such  as  Instrument  flight)  suffer  an  appreciable 
decrement  in  as  little  time  as  three  months. 

Several  factors  were  identified  in  mediating  skill  decay, 
Probably  one  of  the  most  significant  is  initial  skill  level.  That  is, 
all  other  things  considered,  the  higher  an  aviator's  skill  level  prior 
to  a  period  of  no  flying,  the  higher  it  will  be  at  the  end  of  that 
period.  This  has  since  been  indirectly  borne  out  in  work  involving 
retraining  reserve  Army  aviators.  In  retraining  Army  aviators  who  had 
not  flown  for  two  to  nine  years,  Allnutt  and  Everhart  (1930)  found  that 
flight  hours  required  to  retrain  were  a  function  of  total  flight  hours 
accumulated  prior  to  layoff  from  flying.  Total  flight  hours  in  this 
case  was  considered  an  indicant  of  skill  level  achieved  prior  to  onset 
of  the  period  of  no  flying. 

Use  of  a  gross  measure  such  as  total  flight  hours  as  an  indicant 
of  skill  level  Is  typical  of  work  done  in  this  area.  Although  the 
principle  that  overtraining  Improves  retention  is  easily  derived  from 
laboratory  studies  of  human  learning  and  memory,  what  constitutes 


overlearning  of  flight  skills  Is  unclear.  There  are  several  models  of 
the  development  of  skilled  behavior  (e.g.,  Fitts,  1962;  McRuer  & 
Krendel,  1974);  most  of  them  postulate  various  qualitative  "stages"  of 
learning.  Each  of  the  stages  is  characterized  not  so  much  by  "what"  the 
learner  does  as  by  "how"  he  does  it.  The  highest  stage  Is  usually 
characterized  by  akllledi  automatic  behavior  requiring  a  minimum  of 
conscious  attention;  lower  stages  are  characterized  by  conscious 
attention  to  performance.  Most  Independent  variables,  such  as  career 
flight  hours,  and  most  dependent  variables,  such  as  trials  or  time  to 
proficiency,  would  be  Insensitive  to  differences  or  changes  In  "how" 
some  behavior,  such  as  a  normal  approach,  la  performed.  Thus,  as 
Prophet  (1976)  Implies,  a  skill  may  decay  differentially  over  time, 
depending  upon  the  stage  to  which  the  learner  had  progressed  prior  to 
layoff. 

Duration  of  the  layoff  period  (period  of  no  flying)  Is  another 
mediating  factor  discussed  by  Prophet  (1976).  For  Army  aviation,  the 
critical  Issue  Is  the  effect  of  varied  periods  of  layoff  on  skill  loss 
or,  in  other  words,  the  rate  at  which  skills  decay  ao  a  function  of  time 
without  practice.  As  Indicated  above,  skills  In  continuous  control 
Casks  are  lost  much  more  slowly  than  are  skills  in  procedural  tasks. 
But  at  present,  the  Army  has  no  empirical  data  base  on  decay  rates  for 
either  type  of  skill.  The  only  work  In  this  area  Is  a  study  by  Ruffnar 

and  Bickley  (1983),  which  is  now  being  prepared  for  publication.  In 

this  study,  a  group  of  active  Army  aviators  was  restricted  from  flying 
for  periods  varying  from  two  to  six  months.  For  the  set  of  basic 

maneuvers  examined,  this  study  will  give  indications  of  the  degree  of 
operationally  relevant  skill  decay  to  be  expected  of  qualified  Army 
aviators,  at  least  for  periods  of  no  flying  up  to  six  months  In 
duration. 

However,  because  of  the  limited  scope  of  Ruffner  and  Bickley 's 

(1983)  study,  the  Army  still  will  lack  data  on  decay  rates  for  (a) 
Instrument  flight  tasks,  which  are  primarily  procedural;  (b)  special 
tasks,  such  as  weapuuy  delivery;  (c)  special  conditions,  such  as  aided 
or  unaided  night  flight;  and  (d)  all  flying  tasks  for  layoff  periods 
that  exceed  six  months.  It  will  be  difficult  to  conduct  the  research 
needed  to  compile  the  additional  data  on  skill  decay.  As  has  been 
discussed  earlier,  in  order  to  assess  skill  loss,  it  must  be  allowed  to 
occur.  However,  allowing  skill  loss  to  occur  in  active  Army  units  is  in 
direct  conflict  with  the  Army's  higher  mission  of  maintaining  combat 
readiness.  Commanders  are  understandably  reluctant  to  participate  In 
studies  of  this  type. 


Skill  Maintenance 

Quantification  of  skill  decay  rates  is  but  half  the  problem.  Once 
the  decay-rate  data  are  in  hand,  the  most  effective  means  of  maintaining 
the  requisite  skill  levels,  which  would  otherwise  decline,  must  be 
determined.  Again,  theri’  is  no  empirically  determined  data  base  to  use 
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In  addressing  this  problem.  The  present  Aircrew  Training  Manual  (ATM) 
(Department  of  the  Army,  1980)  specifies,  for  each  aircraft  task,  the 
number  of  iterations  recommended  per  six-month  period  to  maintain 
proficiency.  However,  these  reconunendatlons  are  based  on  the  consensual 
estimates  of  training  experts.  The  results  of  the  Ruffner  and  Blckley 
(1983)  research  should  provide  a  starting  point  for  this  work,  since  it 
systematically  varied  the  amount  of  training  aviators  received  over  a 
six-month  period. 


Research  Requirements 

It  seems  safe  to  conclude  that,  although  probably  the  most 
lucrative  target  for  simulator  training,  the  area  of  skill  maintenance 
through  simulator  training  has  been  largely  neglected.  There  is  a  clear 
and  pressing  need  for  research  to  (a)  identify  the  flying  skills  that 
are  subject  to  decay  over  time,  (b)  quantify  the  rate  at  which  skill  on 
each  task  decays  as  a  function  of  mediating  factors  such  as  initial 
skill  level  and  length  of  the  no-practlce  period,  (c)  Identify  the 
optimal  use  of  simulators,  aircraft,  and  other  training  media  In 
preventing  skill  decay  and  In  refreshing  skills  when  decay  la 
unavoidable, 

The  first  task  that  needs  to  be  completed  Is  to  .examine  all 
existing  data  and  summarize  the  conclusions  that  can  confidently  be 
drawn  from  the  data.  Due  to  Prophet’s  excellent  review  published  In 
1976  and  the  paucity  of  research  conducted  since  that  time,  the  review 
and  synthesis  of  the  relevant  literature  is  not  considered  a  major 
undertaking. 

A  second  task  is  to  survey  the  research  designs  that  have  been 
used  to  assess  the  dccay/malntenance  of  flying  skills  of  experienced 
aviators  and  to  identify  or,  if  necessary,  develop  research  designs  that 
are  sultrble  for  conducting  research  on  skill  decay  and  maintenance  in 
experienced  Array  aviators.  Various  methodologies  have  been  proffered 
for  assessing  the  effectiveness  of  simulation  for  sustaining  skills 
(e.g,,  Lockwood  and  Craddock,  1982;  McMullen,  1983).  Most  of  them  are 
some  variation  of  a  regression  analysis  predicting  proficiency  as  a 
Joint  function  of  aircraft  and  simulator  training,  but  all  are  expensive 
in  terms  of  time,  number  of  test  participants,  and  impact  on  combat 
readiness.  " 

A  third  task  is  to  formulate  specific  recommendations  about  the 
research  on  skill  decay/maintenance  that  needs  to  be  conducted  within 
the  context  of  this  research  program  and  apart  from  it.  It  is  essential 
that  these  recommendations  take  Into  account  both  the  methodological  and 
administrative  problems  that  must  be  overcome  In  order  to  accomplish  the 
research.  Careful  study  will  be  required  to  develop  a  research  plan 
that  (a)  is  methodologically  sound,  (b)  yields  the  full  complement  of 
data  that  are  required,  and  (c)  is  acceptable  to  the  Army  officials  who 
must  provide  the  requisite  resources. 


IMPLEMENTATION/MONITORING  OF  SIMULATOR  TRAINING 


Research  Is  needed  to  develop  beCtcr  methods  and  procedures  for 
introducing  new  flight  simulators  into  the  Army's  aviator  training 
system  and  for  ensuring  that  the  simulator  continues  to  be  used  properly 
throughout  its  lifetime.  Improved  methods  and  procedures  must  be 
developed  to  ensure  that  simulator  procurement,  development,  evaluation, 
and  fielding  proceeds  on  a  timely  schedule  chat  matches  the  training 
need.  In  addition,  Improved  methods  and  procedures  are  needed  Co  ensure 
that  (a)  optimal  training  techniques  are  defined  prior  to  placing  the 
simulator  In  the  hands  of  the  operational  user,  (b)  operational  users 
do,  In  fact,  adopt  Che  recommended  training  techniques,  and  (c) 
operational  users  continue  to  employ  the  recommended  training  technique 
throughout  Che  life  of  the  flight  simulator. 


COST-EFFECTIVENESS  ASSESSMENT  SYSTEM 

In  the  past,  most  of  Che  cost-effectiveness  analyses  performed 
within  the  context  of  the  Army's  aviator  training  system  have  been 
designed  to  assess  the  cost  effectiveness  of  a  single  component  of  the 
training  system— in  Isolation  from  the  remaining  components  of  Che 
system.  This  Is  particularly  true  for  flight  simulators.  Although 
there  is  no  question  that  the  results  of  these  analyses  have  yielded 
data  chat  have  been  useful  to  training  managers,  there  are  a  number  of 
shortcomings  Inherent  in  this  approach.  The  shortcomings  stem  mainly 
from  the  fact  Chat  Che  components  of  the  training  system  are  inter¬ 
dependent.  That  la,  modifying  one  component  of  the  training  system  has 
the  potential  for  affecting  Che  training  effectiveness,  and  thereby  the 
cost  effectiveness,  of  other  components  of  the  system.  In  such  a 
situation,  a  device  that  subsumes  the  training  function  of  one  or  more 
of  the  other  components  of  the  training  system  may  appear  highly  cost 
effective  when  evaluated  In  Isolation.  And  yet,  the  device  may  actually 
decrease  the  cost  effectiveness  of  the  training  system  as  a  whole. 

Another  shortcoming  of  single-component  analyses  is  that  ancillary 
costs  are  likely  to  be  overlooked  In  estimating  the  cost  of  the  compo¬ 
nent.  Ancillary  costs  likely  to  be  overlooked  in  single-component 
analyses  are  those  associated  with  any  change  in  the  training  system. 
Examples  of  such  costs  are:  the  cost  of  modifying  computer  software, 
the  cost  of  retraining  maintenance  personnel,  the  cost  of  retraining  a 
cadre  of  Instructors,  and  the  cost  of  redesigning  POIs.  Clearly,  the 
failure  to  consider  such  ancillary  costs  could  result  In  erroneous 
conclusions  about  the  cost  effectiveness  of  a  component  of  the  aviator 
training  system. 

A  final  shortcoming  of  single-component  analyses  Is  that  the 
approach  does  nothing  to  promote  the  Identification  of  the  optimal 
media-mix.  Although  research  methods  and  analytic  techniques  have  been 
developed  to  define  the  optimal  mix  of  simulator  training  and  aircraft 
training  (Blckley,  1980b),  the  Army  has  made  no  attempt  to  develop 


methods  for  defining  the  optimal  mix  of  all  components  of  the  aviator 
training  system. 

The  above  considerations  point  to  the  need  for  a  cost- 
effectiveness  assessment  system  that  cakes  Into  account  all  components 
of  Che  Army's  aviator  training  system.  The  assessments  of  the  benefits 
of  new  components  (devices)  Is  certainly  one  important  function  of  the 
envisioned  cost-effectiveness  assessment  system,  but  there  are  a  host  of 
other  benefits  of  such  a  system.  The  following  paragraphs  discuss  (a) 
Che  most  important  functions  that  would  be  served  by  a  cost-effective¬ 
ness  assessment  system,  (b)  Che  availability  of  techniques  for 
developing  a  dost-ef fecclveneas  assessment  system,  and  (c)  the  generic 
tasks  required  to  create  end  Implement  such  a  system. 


Function  of  the  System 

The  general  function  of  a  cost-effectiveness  assessment  system  is 
Co  provide  training  managers  with  Che  information  they  need  to  make 
decisions  about  the  cost  effectiveness  of  proposed  new  training 
components  or  proposed  modifications  of  tha  design  or  use  of  existing 
components.  In  addition,  Che  assessment  syetem  must  provide  Infomacion 
with  which  to  continuously  monitor  the  aviator  training  system  and  to 
Identify  problems  chat  affect  training  costs.  Examples  of  such  problems 
Include,  but  are  not  limited  Co,  changes  In  Che  abilities  of  training 
personnel,  changes  In  the  effectiveness  with  which  Che  training  devices 
are  actually  employed,  and  changes  In  the  procurement  costs  or 
maintenance  costs  of  devices.  The  system  also  must  snabla  training 
managers  to  anticipate  problems  that  might  arise  in  the  future,  given 
specific  assumptions  about  factors  such  as  mission,  tactics,  and  the 
size  of  the  force. 

The  cost-effectiveness  assessment  system  should  yield  bottom  line 
answers  based  on  the  actual  amount  of  training  produced  per  dollar  of 
expenditure.  These  answers  should  be  derived  from  an  assessment  of  how 
the  entire  system  will  be  affected  by  a  proposed  addition  or 
modi f icat ion . 


Need  for  Sequential  Refinement  and  Continuous  System  Monitoring 

The  system  must  be  designed  such  that  It  "learns"  as  data  are 
accumulated.  This  design  feature,  sometimes  referred  to  as  "artificial 


*^The  Air  Force  has  recently  funded  research  aimed  at  developing  linear 
optimization  models  for  use  In  evaluating  an  entire  training  system, 
Including  defining  the  optimal  mix  of  all  components  of  the  training 
system  (see  Marcus  et  al.,  1980). 


Intelligence"  or  "heuristic  programnlngt"^^  is  a  refinement  of  an  old 
technique  called  sequential  analysis.  Howeveri  there  Is  an  Important 
difference  in  the  function  served  by  the  two  techniques.  The  base 
function  of  sequential  analysis  is  hypothesis  testing;  data  are  input 
until  an  hypothesis  or  alternate  hypothesis  is  rejected.  The  function 
of  heuristic  programming  is  to  refine  a  model  or  to  derive  more  accurate 
estimates  of  key  parameters  of  a  modal.  As  in  sequential  analysis,  the 
heuristic  program  does  not  replace  old  data  when  new  data  are  input; 
the  program  continues  to  use  all  available  data. 


Availability  of  Necessary  Theory  and  Mathematical  Techniques 

The  mathematical  techniques  needed  to  design  and  implement  the 
cost-effectiveness  assessment  system  ere  available  and  are  well  known  to 
the  operations-research  community.^®  The  techniques  include,  but  are 
not  limited  to,  the  following: 

e  linear  and  non-linear  programming, 

•  linear  and  non-linear  goal  programming, 
a  dynamic  programming, 
e  network  models,  and 
e  forecasting. 

All  of  the  techniques  are  scientific  production  methods.  Since  Che  Army 
is  in  the  production  business— the  production  of  training— scientific 
production  methods  are  entirely  appropriate.  A  brief  description  of 
each  of  Che  above  techniques  will  serve  to  illuminate  Che  need  for 
scientific  production  methods. 

Linear  and  non-lineer  programming.  Linear  and  non-linear 
programming  techniques  are  designed  to  optimize  an  objective  function 
subject  to  specified  constraints.  Cost  data  for  each  variable  of 
Interest  are  entered  into  the  function  and  the  function  is  either 
maximized  (amount  of  training)  or  minimized  (training  costs),  subject  to 
the  specified  constraints.  The  most  common  constraints  stem  from 
resource  limitations.  Constraints  are  stated  in  the  form  of  equ.alitles 
or  inequalities  such  as  the  following: 


heuristic  program  is  a  p,;:ogram  that  learns  as  it  is  used.  The  usual 
procedure  is  to  input  historical  data,  let  the  program  generate 
solutions,  then  input  the  actual  solutions.  At  this  point,  the 
program  makes  adjustments  to  the  variables  and  parameters  which  it 
uses  60  that  it  gives  better  solutions  in  the  future.  This  cycle 
(input  data  -  generate  solutions  -  input  actual  solutions  -  adjust¬ 
ments)  continues  during  the  life  of  the  program. 

^ ^Readers  Interested  in  a  more  detailed  discussion  of  these  techniques 
are  referred  to  the  textbook  by  Wagner  (1975)  and  to  the  extensive 
bibliography  presented  on  pages  998-1026  of  his  book. 


•  cotal-hours-of -tralnlng-per-monch  ■  3000,  or 

•  available-hours-of'IP-time  i  3300,  or 

•  tralnlng-hours-per-atudent  i  100 

The  Inequalities  are  changed  to  equalities  by  the  Introduction  of 
"slack"  or  "eurplus"  variables  and  the  resulting  sec  of  simultaneous 
linear  equations  are  solved  such  chat  Che  objective  function  Is 
optimized.  In  other  words,  the  objectlvs  function  Is  optimized  subject 
Co  the  availability  of  resources. 

In  linear  programming,  the  objective  function  and  each  conatralnt 
must  be  linear.  Exponents  and  cross-products  are  excluded  In  the 
problem  statement.  Non-linear  programming  Is  not  restricted  by  Che 
requirement  for  linearity. 

Goal  programming.  Goal  programming  is  essentially  an  extension  of 
linear  and  non-linear  programming  methodology.  The  technique  enables 
the  user  to  specify  multiple  goals  (objective  functions)  and  to  assign 
priorities  to  each  goal.  Within  the  present  context,  goals  for  a  goal 
programming  analysis  might  include  minimizing  costs,  minimizing  training 
time,  and  minimizing  fuel  usage.  In  goal  programming,  each  goal  is 
assigned  weights  or  priorities  such  that  the  optimization  of  all  goals 
(weighted  accordingly)  is  achieved  as  nearly  as  possible,  subject  Co  the 
constraints. 

Network  models.  Network  models  are  designed  to  yield  solutions  to 
problems  such  as  finding  the  shortest  path,  Che  least  costly  path,  or 
Che  shortest  duration  path  from  an  origin  node  to  a  terminal  node.  The 
network  consists  of  a  set  of  nodes,  pairs  of  which  are  connected  by 
directed  arcs.  The  mathematical  solution  Co  the  problem  Is  a  special 
case  of  an  assignment  model. 

Within  the  context  of  the  Army  aviator  training  system,  network 
models  might  be  employed  to  Identify  the  most  cost-effective  path  from 
the  origin  (a  class  of  untrained  student  pilots)  to  the  terminal  (a 
graduating  class  of  trained  pilots).  In  other  words,  network,  models 
might  be  used  to  define  the  training  sequence  that  utilizes  the  class¬ 
room  Instruction,  flight  simulator  training,  aircraft  training,  and 
training  on  other  devices  in  the  most  cost-effective  manner.  The 
objective  of  such  an  analysis  is  to  define  the  order  of  the  various 
training  tasks  that  optimizes  the  cost  effectiveness  of  Che  overall 
training  program. 

Dynamic  programming.  Dynamic  programming  is  an  extension  of 
network  modeling.  The  technique  adds  another  dimension— time — to  the 
network  model.  Dynamic  programming  problems  are  solved  by  the  same 
methods  employed  to  find  solutions  to  network  problems.  The  difference 
between  the  two  techniques  is  that  dynamic  programming  problems  are 
characterized  in  a  way  that  clarifies  their  dynamic  (time-related) 
properties . 
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To  llluscrace  hov  dynamic  programming  might  be  used,  suppose  that 
a  proposal  Is  made  to  add  a  visual  component  to  a  flight  simulator  and 
that  the  visual  system  has  been  shown  to  contribute  positively  to  the 
cost  effectiveness  of  the  system  as  a  whole.  Dynamic  programming  could 
then  be  used  to  schedule  the  various  tasks  required  to  bring  the  visual 
component  on-line  in  the  most  cost-effective  manner.  This  technique 
could  be  used  in  scheduling  such  tasks  as  reprogramming  the  computer, 
training  maintenance  personnel  on  the  visual  component,  and  revising  the 
POI. 


Forecasting.  Forecasting,  a  common  technique,  is  a  necessary 
function  of  a  cost-effectiveness  assessment  system  that  is  to  be  used  to 
monitor  and  predict  the  final  output  of  the  training  ayatam  (training 
per  dollar).  Continuous  data  input  is  critically  important  because 
moving  average,  weighted  moving  average,  exponential  smoothing,  and 
llnear/non-llnear  regression  are  statistical  techniques  that  use 
sequential  data  input  to  Improve  forecasting. 


Overview  of  Requisite  Tasks 

Conduct  user  lurvay.  An  essential  first  step  in  davaloping  a 
C08t-ef fectlvenass  assessment  system  is  to  survey  individuals  within  the 
Amy  who  would  be  expected  to  use  such  a  aysCen.  The  main  objective  of 
the  user  survey  is  to  Identify  the  full  range  of  decisions  chat  might  be 
made  more  objectively  or  on  a  more  timely  basis  with  Che  aid  of  a 
cost-effectiveness  assessment  system. 

Dsfins  system  functions.  The  user  survey  will  provide  the  basic 
Infomation  needed  to  define  the  functions  to  be  served  by  Che  system. 
Generic  functions  of  the  system  that  can  be  Identified  at  this  time 
Include: 

e  define  the  impact  on  training  costs  of  proposed  changes  to  the 
aviator  training  system, 

e  define  the  optlm  1  mix  of  a  specific  set  of  training  media, 

•  identify  the  principle  cost  drivers  within  the  aviator  training 
system, 

•  continuously  monitor  the  aviator  training  system  for  the  purpose 
of  detecting  unexpected  changes  that  Influence  the  costs  and/or 
effectiveness  of  changes, 

•  develop  optimal  methods  for  Implementing  desired  changes  to  Che 
aviator  training  system,  and 

•  forecast  future  training  costs  based  upon  assumed  changes  In 
training  requirements  and/or  assumed  changes  in  personnel  and 
materiel  costs, 

Develop  preliminary  model.  The  next  sub  task  to  be  accomplished  Is 
the  development  of  a  preliminary  model.  The  Intent  is  to  define  an 
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idealized  model  in  the  form  of  a  function-flow  diagram.  The  function- 
flow  diagram  must  be  defined  in  sufficient  detail  to  (a)  identify  the 
type  of  data/ information  required  to  Implement  the  model,  (b)  define  the 
data  processing  and  analysis  requirements,  and  (c)  define  the  type  and 
form  of  the  model's  outputs. 

Determine  type,  form,  and  eecesslbllity  of  existing  data,  k 
survey  of  Army  agencies  will  be  conducted  to  determine  the  type,  form, 
and  accessibility  of  the  data  needed  to  implement  the  cost-effectiveness 
assessment  system.  The  problems  associated  with  obtaining  accurate  cost 
data  from  training-equipment  contractors  must  be  addressed  at  this 
point.  For  some  applications,  it  will  be  necessary  to  obtain  from 
contractors  data  on  the  cost  of  training  devices  or  individual  compo¬ 
nents  of  training  devices.  Obtaining  such  data  Is  complicated  by  the 
fact  that  contractors  are  understandably  reluctant  to  reveal  information 
chat  could  benefit  their  competitors.  Hence,  considerable  thought  must 
be  given  Co  methods  for  deriving  accurate  equipment  cost  data, 
especially  for  equipment  in  the  conceptual  stage  of  development.  The 
product  of  this  task  is  a  listing  of  the  requisite  daca  that  are 
presently  available  and  a  listing  of  Che  requisite  data  that  are  not 
presently  available.  For  data  that  are  available,  the  listing  will 
specify  Che  source  of  the  data  and  the  suitability  of  tha  form  of  the 
data . 


Define  data  compilation  methods.  The  purpose  of  this  task  is  Co 
formulate  methods  for  compiling  the  data  required  to  implement  and 
maintain  Che  cost-effectiveness  assessment  system.  Of  particular 
Importance  is  the  identification  of  the  changes  in  the  Army's  existing 
record  keeping  systems  that  are  required  to  provide  the  type  of  data 
chat  are  needed  in  e  form  Chat  is  needed. 

Develop  detailed  model.  Work  on  the  development  of  a  detailed 
model  will  be  commenced  only  if  Che  results  of  the  previous  subtasks 
Indicate  Chat  the  data  needed  to  exercise  the  model  can  be  compiled  at 
an  Acceptable  cost.  Otherwise,  further  work  should  either  be  terminated 
or  delayed  until  data  support  becomes  feasible.  It  would  be  premature 
Co  define  the  specific  modeling  techniques  that  should  be  eraploySid.  It 
is  likely,  however,  that  some  of  the  techniques  described  in  the  sub¬ 
section  entitled  "Availability  of  Necessary  Theory  and  Mathematical 
Techniques"  will  be  used. 

Validate  and  refine  model.  It  is  important  to  keep  in  mind  Chat 
the  model  will  be  dynamic  in  nature;  changes  and  additions  must  be  made 
routinely.  Once  the  basic  model  is  in  place,  an  initial  validation 
phase  will  be  implemented.  Historical  data  will  be  used  to  validate  the 
integrity  of  Che  model  and  to  point  out  faults  and  omissions.  The 
validation  and  refinement  must  be  an  ongoing  process.  The  heuristic 
qualities  of  the  model,  along  with  sequential  data  input,  will  help  to 
ensure  better  solutions  as  time  passes.  The  type  of  Information  needed 
by  system  managers  for  decision  making  should  also  be  constantly 
monitored  to  ensure  that  the  model  will  be  responsive  to  the  needs  of 
the  decision  makers. 


SECTION  III 

RESEARCH  TO  OPTIMIZE  DESIGN 
AND  USE  OF  PRODUCTION 
SIMULATORS  (SHORT-TERM  PATH) 


As  was  atacad  In  Section  I,  the  Short-Term  Path  Is  a  program  of 
research  that  Is  aimed  at  evaluating  and  optimizing  the  use  of  the 
family  of  flight  simulators  that  the  Array  already  has  acquired  or  has 
contracted  to  purchase,  Since  the  design  of  this  family  of  aimulators 
is  more  or  less  fixed,  the  research  is  focused  mainly  on  ascertaining 
how  beat  to  use  the  devices:  who  should  be  trained,  what  tasks  should 
be  trained,  how  much  training  should  be  administered,  and  what  training 
methods  should  be  employed  for  each  training  application.  This  does  not 
mean  that  design  issues  will  be  Ignored  altogether.  Indeed,  an 
important  secondary  objective  of  the  Short-Term  Path  is  to  identify 
design  modifications  (hardware  and/or  software)  that  will  Improve  the 
training  effectiveness  of  production  simulators  without  Incurring 
excessive  product  improvement  costs.  . 

This  section  begins  with  a  description  of  research  designed  to 
determine  the  optimal  use  of  flight  simulators  in  a  unit-training 
context.  Unit  training  refers  to  the  training  received  by  Army  aviators 
after  they  have  completed  institutional  training  and  have  been  assigned 
to  an  operational  unit.  Unit  training  Includes,  but  by  no  means  is 
limited  to  skill-sustainment  training. 

The  next  major  subsection  described  a  program  of  research  that 
focuses  on  the  use  of  flight  simulators  to  train  contact  flight  skills 
to  beginning  flight  students.  The  final  subsection  describes  a  program 
of  research  whose  purpose  is  to  determine  the  extent  to  which  Night 
Vision  Goggle  training  can  be  accomplished  in  a  flight  simulator 
equipped  with  a  visual  system.  Although  the  Night  Vision  Goggle 
research  is  to  be  conducted  in  an  institutional  training  context,  the 
results  should  be  useful  in  determining  how  best  to  use  simulators  to 
train  Night  Vision  tasks  in  a  unit-training  context. 
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RESEARCH  TO  ASSESS  APPLICATIONS /BENEFITS  OF  AH~1  FLIGHT  SIMULATORS 
FOR  OPERATIONAL-READINESS  TRAINING 


INTRODUCTION 

This  documsnt  describes  a  plan  of  rasaarch  chat  has  as  Its  ganaral 
objective  the  assesamenc  of  Che  benefits  retlleed  from  using  flight 
simulators  to  train  field-unit  aviators.  This  introductory  subsection 
discusses  Che  background  and  focus  of  this  research .  Che  assumed  role  of 
flight  simulators  In  a  unit-training  environment,  and  potential  applica¬ 
tions  of  flight  simulators  In  accomplishing  unit  training.  The 
following  subsection  describes  an  Interrelated  series  of  analytical 
studies  and  empirical  experiments  that,  together,  will  fulfill  Che 
objectives  of  this  project. 


Background 

The  Army's  Synthetic  Flight  Training  System  (SFTS)  has  been 
audited  by  Che  Army  Audit  Agency  (AAA)  on  two  occasions:  first  in  1981 
and  again  In  1984.  The  results  of  the  first  audit  are  described  in  AAA 
Audit  Report  SO  82-6,  (U.S.  Army  Audit  Agency.  1982);  the  results  of  the 
second  audit  are  summarised  in  a  letter  from  Che  Southern  Region  U.S. 
AAA  Co  the  Assistant  Secretary  of  the  Army  for  Research.  Development, 
end  Acquisition  (27  August  1984), 

The  overriding  Issue  In  both  audit  reports  was  the  number  of 
flight  simulators  that  are  required  to  support  ,the  training  of 
field-unit  aviators.  Specifically,  the  AAA  concluded  that  the 
unlc-cralnlng  requirement  can  be  met  with  fewer  flight  simulators  Chan 
are  specified  In  the  Army's  Basis  of  Issue  Plans  (BOIPs) .  In  their 
audit  reports,  the  AAA  has  strongly  emphasized  Chat  both  the  BOIP  and 
the  AAA  analyses  of  flight  simulator  requirements  are  based  on  only  the 
most  vague  Information  about  the  roles  that  flight  simulators  are  to 
play  in  unit  training.  As  a  consequence,  the  AAA  has  strongly  urged  the 
Anny  to  undertake  the  research  needed  to  quantify  the  return  on  the 
Army's  Investment  in  flight  simulators  that  are  to  be  used  solely  to 
train  field-unit  aviators.^® 

It  is  generally  recognized  that  five  factors  must  be  considered  In 
assessing  the  return  on  Che  investment  in  flight  simulators; 

t  the  cost  of  acquiring,  housing,  operating,  and  maintaining  the 
flight  simulators: 

s  the  cost  of  transporting  unit  aviators  to  the  flight  simulator; 

9  the  number  of  aviators  to  be  trained  In  the  flight  simulator; 


^®Tho  return  on  Investment  in  flight  simulators  used  for  institutional 
training  was  not  questioned  by  AAA  and,  therefore,  is  not  among  the 
issues  oddressed  in  this  research  pLin. 
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•  the  amount  of  flight  simulator  training  each  aviator  will 
receive;  and 

•  the  benefits  of  the  flight  simulator  training. 

Information  on  the  first  three  factors  is  available  or  can  easily  be 
obtained,  Howeveri  little  information  is  available  on  the  last  two 
factors:  the  amount  of  flight  simulator  training  unit  aviators  should 
recelvsi  and  the  benefits  of  the  flight  simulator  training.  It  is  these 
two  factors  that  are  the  primary  concern  of  this  research.  Specif i- 
callyi  the  research  has  been  designed  to  generate  data  with  which  to 
specify  the  typo  and  amount  of  training  that  unit  aviators  should 
receive  in  flight  simulators,  and.  to  the  extent  possible,  quantify  the 
bonofits  of  this  training. 


Focus  of  Research 

Early  in  the  research  planning  process.  It  was  concluded  that  the 
initial  research  should  focus  on  a  single  flight  simulator,  and  that  the 
AHIFS  la  more  suitable  for  this  research  than  any  other  flight  simulator 
now  fielded  (UHIFS  and  CH47FS)  or  soon  to  be  fielded  (im60FS) .  Tha 
reasons  for  focusing  on  a  single  flight  simulator  are  twofold.  First, 
conducting  research  on  two  or  more  simulators  concurrently  would  require 
more  research  personnel  than  can  easily  be  mustered.  Second,  conducting 
research  on  two  or  more  flight  simulators  concurrently  would  result  in 
unnecessary  duplication  of  effort.  That  is.  it  Is  believed  that  much  of 
what  la  learned  from  the  initial  research  on  the  AHIFS  can  be  general¬ 
ized  to  other  rotary-wing  flight  simulators  of  similar  design  that  are 
to  be  used  for  unit  training. 

Factors  considered  in  selecting  the  single  most  suitable  flight 
simulator  include:  the  number  of  unit  aviators  available  to  participate 
in  the  research,  the  number  of  simulators  available  at  field-unit 
locations,  end  the  range  of  tasks  that  ars  potentially  trainable  in  the 
flight  simulator.  On  all  three  counts,  the  AHIFS  was  judged  more 
suitable  than  the  CHA7FS,  or  the  UH60FS.  The  UHlFS  does  not  qualify  aa 
a  candidate,  mainly  because  UHlFSa  are  not  equipped  with  a  visual 
system. 


Role  of  Flight  Simulator  Training 

The  research  proposed  herein  Is  based  on  the  fundamental  premise 
that  the  role  of  the  flight  simulator  is  to  augment  rather  than  replace 
aircraft  training.  At  the  time  the  Army's  SFTS  was  conceived,  it  was 
assumed  that  the  use  of  flight  simulators  would  reduce  the  aircraft 
hours  and  the  munitions  required  for  unit  training.  Since  that  time, 
however,  there  has  been  a  steady  decrease  in  the  flying  hours  and 
munitions  allotted  to  unit  training  and  a  dramatic  increase  in  the  level 
of  skill  required  to  function  effectively  on  the  modern  battlefield. 


Consoquencly ,  It  Is  unrealistic  to  expect  that  the  use  of  flight 
simulators  will  result  In  a  further  reduction  In  either  the  aircraft 
hours  or  the  munitions  that  are  needed  for  unit  training. 

This  premise  has  two  Important  Implications.  Flrati  the  benefits 
of  flight  simulators  must  be  measured  In  terms  of  increased  aviator 
proficiency  rather  Chan  reduced  training  costs.  Second,  1C  will  be 
necessary  to  establish  the  value  of  Increased  aviator  proficiency  In 
order  to  determine  che  return  on  the  Investment  In  flight  simulators. 


Potential  Applications 

A  necessary  first  step  In  designing  research  to  assess  the 
training  effectiveness  of  the  AHIFS  Is  to  Identify  the  full  range  of 
potential  training  applications  In  the  unit-training  context.  The 
following  paragraphs  describe  che  potential  applications  Chat  are 
apparent  at  thla  time.  The  research  haa  been  designed  to  assess  Che 
training  effectiveness  of  Che  AHIFS  for  each  of  these  applications. 


Refresher  Training 

Every  avlatlon-unlt  commander  Is  responsible  for  che  development 
and  Implementation  of  a  unit  ref rasher-Crelnlng  program.  This  program 
is  designed  to  assist  ARL3  (Aviator  Readiness  Level-3)  aviators  to 
regain  their  proficiency  on  Che  base  tasks  designated  by  Che  unit 
commander.  Refresher  training  Is  mandatory  for  aviators  returning  Co 
operational  flying  after  having  been  prohibited  or  excused  from  flying 
duties  for  more  than  180  days.  Also,  the  unit  commander  has  the  option 
of  requiring  refresher  training  for  aviators  with  fewer  chan  180  days  of 
non-fllghc  duties.  It  Is  estimated  thet  between  15  and  25  AH-1  aviators 
In  an  air  cavalry  attack  brigade  will  require  refresher  training  each 
year,  and  that  between  five  and  15  aircraft  hours  per  aviator  will  be 
required  to  accomplish  the  refresher  training. 

Although  flight  slmulatore  seem  ideally  suited  to  refresher 
training,  there  are  no  data  with  which  to  estimate  the  effectiveness  of 
any  Army  flight  simulator  for  refreshing  Army  aviators'  flying  skills. 
As  a  consequence,  this  research  has  been  designed  to  determine  in  what 
way,  and  to  what  extent,  the  AH-1  flight  simulator  can  be  used  to 
fulfill  the  refresher  training  requirements. 


Sustainment  Training 

It  Is  generally  recognized  Chat  sustainment  training  is  a  poten¬ 
tially  beneficial  application  of  flight  simulators.  However,  the  manner 
in  which  flight  simulators  are  used  to  sustain  flying  proficiency  Is 
greatly  influenced  by  the  Army's  training  policy.  Under  the  current 
training  concept,  unit  commanders  are  encouraged  to  develop  training 


scenarios  for  mission-support  flights  that  will  ensure  chat  aviators 
practice  as  many  Casks  as  possible  during  routine  mission  support 
flights. 

If  unit  commanders  adhere  strictly  Co  this  pollcyi  Che  practice 
performed  during  mission-support  flights  in  the  aircraft  should  be 
sufficient  to  sustain  skills  on  many  flying  casks.  However,  there  are 
some  tasks  for  which  skills  simply  cannot  be  sustained  during  mission- 
support  flight,  regardless  of  the  scenario  adopted.  One  example  Is 
touchdown  emergency  procedures.  Under  current  policy,  unit  aviators  are 
prohibited  from  performing  touchdown  emergency  procedures  during 
training.  Operation  of  weapons  systems  Is  another  example  of  tasks  for 
which  skills  cannot  be  sustained  during  mission-support  flying.  Suffi¬ 
cient  practice  on  weapons  systems  la  pravanted  by  constraints  such  as 
llmltsd  supply  of  munitions  for  training  and,  for  some  units,  limited 
access  to  suitable  firing  ranges. 

The  above  considerations  make  It  apparent  that,  If  flight 
simulators  are  Co  be  used  affectively  for  sustaining  skills,  flight 
simulator  training  must  focus  only  on  the  aubaet  of  tasks  for  which 
skills  are  not  maintained  during  routine  mission-support  flights. 

There  Is  a  great  deal  of  anecdotal  evidence  that  the  amount  of 
training  required  to  sustain  flying  skills  varies  as  a  function  of  an 
aviator's  prior  flying  experience  and  the  aviator's  aptitude.  So,  chase 
factors  have  been  taken  Into  account  in  designing  research  to  assess  Che 
benefits  of  using  flight  simulators  to  sustain  the  skills  of  unit 
aviators. 


Enrichment  Training 

Enrichment  training  Is  another  potential  application  of  flight 
simulators  in  a  unit-training  context.  As  the  term  Is  used  here, 
enrichment  training  refers  to  simulator  training  that  ar.compllshes  one 
or  more  of  the  following! 

e  increases  the  r.ite  st  which  skills  are  acquired  through  aircraft 
training  alone, 

•  increases  the  level  of  skill  achievable  through  aircraft 
training  alone, 

e  provides  training  on  tasks  that  are  not  currently  trained  in  the 
aircraft,  and 

e  provides  training  on  tasks  that  cannot  be  trained  in  the 
aircraft . 

The  type  and  amount  of  enrichment  training  an  aviator  needs  is  largely 
dependent  upon  the  aviator's  level  of  experience;  so,  the  enrichment 
training  needs  of  low-time  aviators  and  of  medium/hlgh-tlme  aviators  are 
discussed  separately. 


Low-clma  avlatori.  It  !■  widely  recognized  that  aviators  who  have 
recently  graduated  from  an  Aircraft  Qualification  Course  (AQC)  lack  the 
level  of  flying  akllla  needed  to  fly  safely  and  to  perform  effectively 
in  combat.  Although  there  are  no  empirical  data  that  can  be  used  to 
specify  the  type  and  extent  of  low-time  aviators'  skill  deficiencies, 
the  training  practices  of  unit  commanders  leave  no  doubt  that  such  skill 
deficiencies  exist.  For  Instance,  some  unit  commanders  require  all  new 
AQC  graduates  to  complete  the  unit's  refresher  training  program  before 
being  assigned  a  position  In  the  unit.  Furthermore,  there  is  anecdotal 
evidence  that  aviators  are  not  permitted  to  fly  as  Pilot  In  Command 
(PIC)  until  they  have  accumulated  about  200  hours  flying  as  copilot,  and 
have  demonstrated  bo  the  unit  commander  that  they  posaeas  the  necessary 
level  of  akin  and  Judgment  to  assume  the  responalbllltlss  of  PIC. 

Although  most  low-time  aviators  eventually  acquire  the  necessary 
level  of  skill  through  aircraft  training  alone,  it  aeems  highly  probable 
that  the  desired  level  of  skill  could  be  achieved  much  more  quickly  If  a 
low-time  aviator's  normal  flying  activities  were  augmented  with  training 
In  a  flight  simulator.  Aa  la  discussed  later,  the  proposed  research  has 
been  designed  to  determine  the  extent  to  which  flight-simulator  training 
decreesea  the  amount  of  time  that  s  lov-tlme  aviator  requires  to  achieve 
the  skills  necessary  to  assume  the  responsibility  of  PIC. 

At  this  point,  It  should  be  mentioned  that  a  fundamental  objective 
of  the  enrichment  training  program  la  to  aid  low-time  aviators  In 
reaching  the  "autonomous  phase"  of  learning  for  both  procedural  and 
paychomotor  tasks.  During  this  phase  of  skill  learning,  task  perfor¬ 
mance  becomes  Increasingly  autonomous,  less  subject  to  cognitive 
control,  and  less  subject  to  Interference  from  other  ongoing  activities 
or  environmental  distractions.  Once  aviators  have  reached  the  autono¬ 
mous  phase  of  learning,  flying  tasks  can  be  performed  while  new  learning 
la  In  progress  or  while  an  Individual  Is  engaged  in  other  perceptual  and 
cognitive  activities. 

Medium-  and  high-tlme  aviators.  Enrichment  training  in  a  flight 
sirai-ilntor  also  has  considerable  potential  for  increasing  the  combat 
skills  of  medium-  and  high-time  aviators,  Because  of  various  con¬ 
straints  on  training  in  the  aircraft,  even  the  most  experienced  aviators 
may  lack  the  skill  needed  to  perform  effectively  under  some  of  the 

adverse  conditions  that  almost  certainly  will  be  encountered  in  combat. 
Accordingly,  as  It  la  presantly  conceived,  enrichment  training  for 
medium-  and  hlgh-tlme  aviators  would  be  designed  to  accomplish  the 

following! 

•  train  aviators  to  perform  selected  flying  tasks  under  adverse 
visibility  conditions,  such  as  darkness,  fog,  rain,  snow,  smoke, 
and  dust; 

e  train  aviators  to  perform  selected  flying  tasks  with  night- 

vision  goggles  (NVGs)  and  mlBsion-orlented  protective  posture 

(MOPP)  gear; 


•  train  aviators  to  parfom  effectively  during  periods  of  heavy 
cognitive  and  perceptual  motor  workload; 

e  train  aviators  to  parfom  effectively  under  high  affective 
loading  (stressi  fear); 

e  train  aviators  to  recognize  the  limits  of  the  aircraft's  flight 
envelope; 

e  train  aviators  on  the  techniques  of  alr-to**alr  combat »  including 
how  to  fly  near  but  not  exceed  Che  performance  envelope  of  the 
aircraft; 

e  train  aviators  to  perform  evasive  actions  for  the  full  range  of 
enemy  threat  weapons,  including:  enemy  aircraft,  air  defense 
missiles,  and  small  arms  fire;  and 

e  train  aviators  to  make  valid  judgments  under  varying  levels  of 
information  uncertainty,  cognitive  complexity,  time  constraints, 

and  Stress. 

With  minor  modifications  of  the  AH-I  flight  simulator,  it  may  also 
be  possible  to  design  simulator  training  to  increase  aviators'  tactical 
decision-making  skills. 

It  is  expected  Chat  most  of  Che  enrichment  training  for  medium- 
end  high-time  aviators  will  Cake  the  form  of  complex  mission  scenarios. 


Safety  Enhancement  Training 

A  third  potential  application  of  flight  simulators  is  to  provide 
training  Chat  is  specifically  designed  to  reduce  Che  incidence  bf 
accidents.  Although  any  training  chat  serves  Co  Increase  the  flying 
skills  of  Army  aviators  will  likely  contribute  to  aviation  safety,  the 
flight  simulator  training  proposed  here  will  be  designed  specifically  to 
reduce  Che  incidence  of  specific  types  of  aircraft  accidents.  The  four 
types  of  accident  reduction  training  that  appear  most  promising  are 
discussed  below. 

Accident  scenario  training.  The  first  type,  accident  scenario 
training,  involves  the  use  of  a  flight  simulator  to  reenact,  as 
faithfully  as  possible,  all  the  conditions  end  actions  t'  it  have  been 
shown  to  contribute  (directly  or  Indirectly)  to  a  frequently  occurring 
type  of  accident.  In  principle,  the  accident  scenario  training  will 
teach  aviators  to  recognize  hazard  cues  and  teach  them  to  recover  the 
aircraft  safely  when  the  accident-producing  situation  Is  encountered. 
Personnel  from  the  U.S.  Army  Safety  Center  will  be  responsible  for 
providing  information  about  frequently  occurring  accidents  and  the 
factors  that  contribute  to  such  accidents. 

Flight  envslope  training.  A  second  type  of  simulator  training 
that  may  enhance  safety  is  referred  to  here  as  flight  envelope  training. 


Some  aircraft  accidents  occur  whan  an  aviator  deliberately  or  Inadver¬ 
tantly  flies  an  aircraft  to  the  extremes  of  the  flight  envelope  and  is 
unable  to  control  the  aircraft  in  that  situation.  Safety  considerations 
prevent  IPs  from  exposing  trainees  to  the  handling  qualities  of  the 
helicopter  whan  flying  near  the  extremes  of  its  flight  envelope. 
Consequently,  the  trainee  may  be  unprepared  to  control  the  aircraft  when 
such  situations  are  encountered.  It  seems  probable  that  this  skill 
deficiency  could  be  eliminated  through  training  in  a  flight  simulator. 
This  type  of  training  differs  from  advanced  enrichment  training  in  that 
it  focuses  only  on  the  extremes  that  are  known  to  contribute  to 
frequently  occurring  accidents. 

Extreme  conditions  training.  A  third  type  of  safety  enhancement 
training,  extreme  conditions  training,  is  also  driven  by  data  on  Array 
aircraft  accidents.  The  objective  is  to  identify  the  types  of  extreme 
environmental  conditions  that  frequently  contribute  to  aircraft 
accidents  and  to  use  the  simulator  to  train  aviators  to  maintain  control 
of  the  aircraft  when  such  situations  cannot  be  avoided. 

Aircrew  judgment  training.  The  final  type  of  safety  enhancement 
training,  aircrew  judgment  training,  is  aimed  at  reducing  Army  aircraft 
accidents  that  are  caused  wholely  or  in  part  by  by  poor  judgment.  To 
accomplish  such  training,  it  will  be  neceasary  to  simulate  as  closely  as 
possible  the  conditions  that  contribute  to  accident-producing  judgments. 
These  conditions  Include,  but  are  not  necessarily  limited  to  the 
following; 

e  information  uncertainty, 
e  time  constraints, 
s  cognitive  complexity  of  Judgment, 
e  stress, 

e  the  flight  problem,  and/or 
e  the  background  problem. 


Maintenance  Test  Pilot  (MTP)  Training 

rtlthough  the  training  of  Ml’Pa  does  not  constitute  a  major  training 
burden,  it  is  nevertheless  a  potential  training  application  of  flight 
simulators  that  should  not  be  overlooked.  Given  the  capability  to 
program  malfunctions  and  given  adequate  fidelity  of  the  simulator  s 
response  charscteristlcs,  MTPs  could  sequire  consldereblc  knowledge  in  u 
flight  simulator  about  malfunction  detection  and  diagnosis. 


RESEARCH  PL.\N 

This  section  describes  a  plan  of  research  thar  has  been  designed 
to  provide  data  with  which  to  assess  the  benefits  and  limitations  of 
employing  flight  simulators  to  train  field-unit  aviators.  Although  this 
research  was  designed  specifically  tc  evaluate  the  AHIFS,  the  general 
approach  is  considered  suitable  for  assessing  the  unit-training  benefits 
and  limitations  of  any  Array  flight  simulator. 
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The  task-flow  diagram  in  Figure  7  shows  the  research  tasks  to  be 
accomplished  and  shows  the  interrelationship  among  the  tasks.  Each  of 
the  tasks  shown  In  Figure  7  is  discussed  below  in  the  order  In  which 
they  are  to  be  accomplished. 


Conduct  Analytical  Studies 

This  project  will  commence  with  two  analytical  studies.  The 
product  of  the  first  study  will  be  a  training-task  taxonomy;  the  product 
of  Che  second  study  will  be  a  listing  of  target  training  tasks  and 
conditions. 

Develop  training-task  taxonomy.  An  important  part  of  this 
research  is  the  development  of  a  comprehensive  training-task  taxonomy. 
An  acceptable  taxonomy  must  list  the  full  set  of  flying  casks  chat  AH-1 
aviators  must  be  capable  of  performing,  and  the  full  range  of  conditions 
in  which  aviators  muat  be  capable  of  performing  each  task.  The  Aircrew 
Training  Manual  (ATM)  task  list  represents  a  good  point  nf  departure, 
but  cannot  be  used  in  its  present  form  for  two  reasons.  First .  the  ATM 
tasks  differ  greatly  in  thalr  level  of  specificity;  some  tasks*  such  as 
Hovsrlng  Turn,  are  very  specific;  other  Casks,  such  as  Mavlgation  by 
Dead  Reckoning,  are  very  general.  Second,  the  ATM  tasks  are  not 
mutually  exclusive;  chat  is,  some  ATM  tasks  are  composites  of  several 
other  ATM  Casks. 

The  final  product  will  be  e  Cask-by-condition  matrix  chat  shows, 
for  each  task,  the  conditions  under  which  an  AH-1  aviator  may  be 
required  to  perform  that  task.  The  training  task  taxonomy  will  be 
developed  end  evaluated  by  knowledgeable  aviators  and  training  experts. 
The  training  task  taxonomy  will  be  continuously  refined  until  it  is 
possible  to  define  any  training  scenario  by  linking  tosether  task/ 
condition  combinations  represented  by  cells  in  the  matrix. 

Identify  target  training  Casks/conditions.  The  purpose  of  this 
analytical  effort  lo  to  examine  each  cell  in  the  task/condition  matrix, 
and  to  identify  the  Casks/conditions  for  which  flight  simulator  training 
is  possible  and  probably  beneficial.  A  thorough  study  of  the  deslgti 
characteristics  of  the  AH-1  flight  simulator  will  be  required  to  deter¬ 
mine  whether  or  not  It  is  pobsi'ule  to  simulate  a  given  task/condltlon. 
When  It  is  clear'* that  a  task/condltlon  combination  cannot  bo  simulated, 
an  attempt  will  be  made  to  determine  whetnor  or  nut  a  Irw-cott  design 
modification  would  make  it  posarble  to  simulate  the  task/condition  In 
question.  If  sc,  the  simulator  design  modification  will  be  recommended. 
If  not,  the  task/condition  will  be  eliminated  from  further 
consideration. 

Each  of  the  task/condltlon  combinations  that  remain  in  the  matrix 
will  then  be  examined  and  a  Judgment  made  as  to  whether  or  not  benefits 
would  result  from  training  that  task  in  the  Afl-1  flight  simulator.  This 
analytic  Judgment  will  be  made  with  respect  to  three  target  groups: 
aviators  who  require  refresher  training,  low-time  unit  aviators,  and 
medium-  and  high-time  unit  aviators. 


CONDUCT  ATULYTICAL 
STUDIES 


The  most  critical  and  most  difficult  part  of  this  effort  will  be 
to  Judge  whether  or  not  an  adequate  level  of  skill  on  a  given  task/ 
condition  can  be  acquired  and  sustained  during  routine  mission-support 
flying.  Obviously,  simulator  training  makes  no  sense  if  aviators  can 
easily  acquire  and  sustain  skill  on  a  task  during  routine  mission- 
support  flying.  In  order  to  make  such  Judgments,  it  will  be  necessary 
to  conduct  structured  interviews  with  selected  field-unit  aviators  and, 
possibly,  selected  DES  personnel  as  well. 

The  taska/condltions  remaining  in  the  matrix  constitute  the  target 
tasks/condltiona  that  are  to  be  investigated  during  the  empirical 
research. 

Before  proceeding,  it  should  be  stated  chat  Judgments  about 
whether  simulator  training  is  possible  and  beneficial  will  be 
conservative.  That  is,  no  Caak/condition  will  be  eliminated  from  Che 
matrix  if  chare  Is  a  reasonable  chance  Chat  simulator  training  on  that 
cask/condlcion  would  ba  possible  and  beneficial. 


Revlew/Reanalysa  Existing  Data 

The  objectives  of  this  analytical  effort  are  (a)  to  review  and, 
when  necessary,  reanalyze  existing  data  bearing  on  the  use  and  benefits 
of  flight  simulator  training,  and  (b)  use  the  composite  data  to  draw 
inferences  about  Che  design  of  Che  empirical  research  to  be  conducted 
subsequently. 


Conduct  Backward  Transfer  Studies 

Research  requirement.  A  "backward  transfer  study"  is  one  chat  is 
designed  Co  measure  the  degree  to  which  actual  flying  skills  transfer  to 
a  flight  simulator.  Only  highly  experienced  aviators  are  used  as 
subjects  in  a  backward  transfer  study.  The  procedure  is  simple:  an 
experienced  aviator  is  placed  in  the  flight  simulator  and  instructed  to 
perform  the  task  of  Interest  without  the  benefit  of  practice.  If  the 
aviator  is  able  to  perform  the  task  to  criterion,  backward  transfer  is 
said  to  have  occurred.  The  presence  of  backward  transfer  Indicates  that 
transfer  from  the  flight  simulator  to  the  aircraft  is  likely  to  be 
positive,  but  provides  no  information  with  which  to  estimate  the  magni¬ 
tude  of  the  positive  transfer. 

More  important  for  purposes  of  this  research  is  the  lack  of  a  high 
degree  of  backward  transfer.  The  inability  of  experienced  aviators  to 
perform  a  task  to  criterion  in  the  flight  simulator  must  be  taken  as 
evidence  oi  a  problem  with  either  the  design  or  the  functioning  of  the 
flight  simulator.  Hence,  the  absence  of  a  high  degree  of  backward 
transfer  signals  the  need  for  further  study  of  the  flight  simulator's 
characteristics  to  determine  the  reasons  for  the  low  backward  transfer. 
It  Is  essential  that  such  problems  be  resolved  before  proceeding  to  the 
more  costly  training  effectiveness  studies. 
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A  variation  of  the  backward  transfer  study  is  to  train  the 
experienced  aviators  in  the  slnulator  until  their  performance  reaches  an 
asymptotic  level.  This  variation,  of  course,  is  appropriate  only  whan 
there  is  a  low  degree  of  backward  transfer.  The  nature  of  the  learning 
curve  in  such  cases  provides  useful  diagnostic  information.  For 
Instance,  if  the  learning  curve  asymptotes  below  the  criterion  level  of 
performance.  It  must  be  concluded  that  the  flight  simulator  is  elthar 
not  providing  the  necessary  cues  or  is  Incapable  of  processing  control 
Inputs  correctly.  Conversely,  if  the  learning  asymptotes  at  the 
criterion  level  after  only  a  few  practice  trials.  It  can  be  concluded 
that  the  lack  of  high  backward  transfer  is  probably  the  result  of  minor 
differences  between  the  stimuli  and/or  handling  qualities  of  the 
simulator  and  those  of  the  aircraft. 

A  second  variation  of  the  backward  transfer  study  is  to  interview 
the  subjects  a  second  time  after  their  first  aircraft  flight  following 
simulator  training.  These  Interviews,  like  the  earlier  ones,  would  be 
aimed  at  identifying  (a)  differences  between  the  handling  qualities  of 
the  simulator  and  the  aircraft,  and  (b)  differences  between  the  cues 
available  in  the  simulator  and  the  aircraft  in  flight, 

Resaarch  objectives.  The  backward  transfer-of-tralnlng  studies 
have  the  following  objectives! 

e  validate  the  results  of  the  analytic  study  (can  task  bt  per¬ 
formed  In  the  flight  simulator?), 

e  validate  simulator  functioning, 

e  Identify  low-cost  simulator  design  modifications  that  would 
Increase  the  degree  of  backward  transfer, 

•  establish  upper  limit  of  performance  in  the  flight  simulator, 
and 

•  determine  the  amount  of  flight  simulator-unique  learning  that  is 
required  to  perform  to  criterion  level  in  the  simulator. 

Research  approach,  Twenty-five  Atl-1  instructor  pilots  (IPs)  who 
have  had  no  prior  exporlcnca  iti  the  AK-l  flight  simulator  will  serve  as 
subjects  in  the  study.  Each  subject  will  be  required  to  perform  each 
one  of  a  selected  sample  of  tasks/conditions.  The  sample  of  tasks/ 
conditions  will  be  selected  to  cover  the  full  range  of  target  tasks/ 
conditions  identified  during  the  preceding  analytic  study.  Bach 

subject's  performance  will  be  measured  on  three  consecutive  trials.  If 
performance  has  not  reached  criterion  by  the  third  trial,  the  subject 
will  continue  until  performance  reaches  an  asymptotic  level. 

After  completing  each  task/condition,  the  subjects  will  be 

required  to  complete  a  rating  form  designed  to  identify  the  type  and 

magnitude  of  differences  between  the  aircraft  and  the  flight  simulator, 
with  respect  to  the  task/conciition  Just  performed.  If  deemed 
beneficial,  the  subjects  will  be  required  to  complete  similar  rating 

forma  after  their  first  aircraft  flight  following  simulator  training. 


The  performance  measures  to  be  employed  Include:  proficiency 
racings  by  a  trained  observeri  self  ratings  of  proficiency  by  the  IP  who 
is  serving  as  a  subject  in  Che  experiment,  and  objective  measures  of 
selected  flight  parameters  extracted  from  the  flight  simulator. 

Research  products.  The  specific  products  expected  from  the 
backward  transfer  studies  include  the  following: 

e  a  listing  of  Che  potentially  trainable  tasks/conditions; 

e  an  indication  of  Che  best  performance  achievable  in  the  flight 
simulator,  by  Cask  and  condition; 

■  a  listing  of  Che  tasks/conditions  chat  are  not  trainable  in  thu 
flight  simulator,  and  an  Indication  of  why  these  tasks/ 
conditions  are  not  trainable; 

a  a  listing  of  low-cost  simulator  modifications  that  should 
Increase  the  degree  of  backward  transfer;  and 

•  a  listing  of  alternative  methods  or  devices  Chat  would  be  more 
suitable  for  training  tasks/conditions  for  which  backward 
transfer  is  found  Co  ba  low. 

Resource  requiremanCa.  Twenty-five  experienced  AH-1  IPs  will  be 
required  to  serve  as  subjects  In  this  experiment.  Another  two  AH-1 
aviators  who  are  thoroughly  familiar  with  the  AH-1  simulator  will  be 
required  to  operate  Che  flight  simulator  and  rate  the  subjects'  perfor¬ 
mance.  It  is  estimated  Chat  each  subject  will  be  required  to  spend 
approximately  5  hours  in  the  flight  simulator  and  that  about  25  hours  of 
flight  simulator  time  wll.l  be  required  to  develop  the  data  collection 
procedures . 


Conduct  In-Simulator  Skill  AcqulslClon/Reacqulsltlon  Studies 

Research  requirement.  The  training  effectiveness  of  any  tralnins 
device  is  largely  determined  by  the  manner  in  which  it  is  used.  This  is 
particularly  true  for  flight  simulators.  And  yet,  there  is  little 
emplrlcfil  data  that  can  be  used  to  identify  near-optimnl  training 
methods  and  procedures.  Hence,  before  research  is  conducted  Co  assess 
the  training  effectiveness  of  the  AH-1  flight  simulator,  it  is  essential 
that  research  be  conducted  Co  assess  the  relatlvq,  effectiveness  of 
alternative  simulator-training  methods  and  procedures.  This  research 
must  address  Che  following  training-program  design  issues  and  perhaps 
others  as  well; 

•  the  order  in  which  Caaks  are  trained; 

•  the  amount  of  training  on  each  task/condition  (fixed  number  of 
practice  Iteraticns  vs.  training  Co  criterion); 

•  type  of  practice  (repeated  iterations  on  Indlvidunl  tasks  vs.  a 
training  scenario); 


•  training  schedule,  including  duration  of  flight  simulator 

training  and  the  interval  between  sustalnment/enrlchment 

training  sessions; 

•  the  type  of  feedback  provided  to  the  trainee;  and 

•  the  use  of  the  instructional  support  features  available  on  the 
AH-1  flight  simulator. 

Research  objectives.  The  objectives  of  this  research  are  to 
develop  and  evaluate  the  relative  effectiveness  of  alternative  training 
methods  for  each  type  of  flight  simulator  training  application, 
including: 

•  refresher  training, 

e  basic  enrichment  training, 

•  advanced  sustalnment/enrichnent  training, 

•  safety  enhancement  training, 

— accident  scenario  training, 

—extreme  conditions  training, 

— flight  envelope  training, 

—Judgment  training,  and 

e  maintenance  test  pilot  training. 

Research  approach.  A  critical  promise  underlying  this  research  is 
that  valid  decisions  about  training  methods  can  be  made  from  in- 
simulator  performance  data.  Hence,  the  general  research  approach  to  be 
employed  consists  of  examining  in-simulator  skill  acquisition  as  a 
function  of  training  method.  The  independent  variables  to  be  investi¬ 
gated  Include; 

e  training  application  (refresher,  enrichment,  etc.), 

t  training  methods  and  procedures,  and 

•  the  sequence  in  which  the  tasks  ore  trained. 

The  dependent  variables  for  this  research  include: 

•  iterations  to  asymptotic  performance, 

•  training  time  to  asymptotic  performance, 

•  highest  level  of  skill  achieved,  and 

•  performance  variability. 

Research  products.  This  research  will  yield  the  data  needed  to 
define  a  near-optimal  training  method  for  each  simulator  training 
application  identified  above. 

Resource  requirements.  It  is  estimated  that  six  separate  studies 
will  be  conducted,  and  that  each  study  will  require  a  total  of  twelve 
AH-1  aviators  to  serve  as  subjects.  The  characteristics  of  the  aviators 
required  for  the  study  are  as  follows: 

•  refresher  training  study — AH-1  qualified  hut  not  current; 

a  basic  enrichment  training — Ali-1  qualified,  current,  and  low- 
time; 


•  advanced  sustainment/enrlchmenc — AH-1  qualified,  current,  and 
medlun-Clroe; 

•  safety  enhancement 

— accident  scenario  training — AH-1  qualified,  current,  and 
raedlum-tlme; 

— extrema  conditions  training — AH-1  qualified,  current,  and 
medium-time; 

— flight  envelope  training— AH-1  qualified,  current,  and 
medium-time; 

—judgment  training — AH-1  qualified,  current,  and  medium-time; 
and 

e  maintenance  test  pilot  training— AH-1  qualified,  current,  and 
medium-time , 

In  addition  to  avlatc'i  to  serve  as  subjects,  two  experienced  IPs 
will  be  needed  to  operate  the  simulator  and  evaluate  the  subjects' 
performance. 

It  is  estimated  that  from  300  to  600  hours  of  simulator  time  will 
be  required  to  develop  the  research  procedures  and  to  conduct  the 
research, 


Develop  Training  Methoda/Procedurea 

The  composite  results  of  the  analytical  studies,  the  backward 
transfer  studies,  and  the  In-simulator  skill  acqulsltlon/reacqulsitlon 
studies  will  be  used  to  develop  training  methods/procedures  for  each  of 
the  following  types  of  flight  simulator  training: 

e  refresher  training, 

e  basic  enrichment  training, 

•  sustainment  and  advanced  enrichment  training, 

•  safety  enhancement 

— accident  scenario  training, 

— extreme  conditions  training, 

--flight  eriA'cIope  training, 

—judgment  training,  and 

•  maintenance  test  pilot  training. 

The  training  methods  and  procedures  will  be  developed  by  a  team 
composed  of  experienced  AH-1  aviators,  psychologists,  training  technolo¬ 
gists,  and  experts  in  simulator  design. 


Evaluate  Refresher  Training  Program 

Research  requirement.  Some  portion  of  a  unit  commander's  annual 
flight  hour  program  la  devoted  to  the  use  of  AH-1  aircraft  time  for 
refresher  training.  The  commander's  guide  to  the  aircrew  training 
manual  (FC-1-210)  defines  refresher  training  as  training  for  av..atora 


"prohibited  or  excused  from  flying  duties  for  more  than  ISO  days"  (p. 
2-34).  Anecdotal  evidence  suggests  Chat  between  5  and  15  AH-i  aircraft 
hours  are  required  to  "refresh"  the  skills  of  ARL3  aviators.  It  is 
posalble  chat  a  significant  portion  of  the  refresher  training  currently 
being  conducted  in  the  AH-I  aircraft  could  be  accomplished  in  Che  AHIFS. 
Thus,  a  requirement  exists  to  determine  in  what  way,  and  to  what  extent, 
the  AHIFS  can  be  used  to  fulfill  these  refresher  training  requlramants. 

Research  objective.  The  objective  of  this  research  is  Co  obtain 
data  with  which  Co  evaluate  Che  effectiveness  of  the  AHIFS  for  accom¬ 
plishing  refresher  training  of  ARL3  aviators. 

Research  approach.  The  research  will  utilire  a  modified  version 
of  the  transfer-of-training  paradigm.  Thirty-six  AH-1  aviators  who  have 
not  flown  for  at  least  180  days  will  be  matched  demographically  and 
divided  into  three  groups.  One  group  of  12  aviators  will  receive 
refrnaher.  training  in  the  AH-1  aircraft  (aircraft  training  control 
group).  A  second  group  of  12  aviators  will  undergo  12  hours  of  mental 
rehei?>rsal  of  all  relevant  tasks  under  the  supervision  of  a  trained  AH-1 
IP  before  being  trained  to  criterion  in  the  AH-1  aircraft  (mental 
ptaccice  control  group).  The  third  group  of  12  aviators  will  receive 
AHIFS  training  until  proficient  on  all  relevant  tasks  and,  subsequently, 
will  be  trained  to  criterion  in  the  aircraft  (experimental  group). 

The  effectiveness  of  Che  AHIFS  for  refresher  training  will  be 
evaluated  using  the  following  performance  measures : 

e  Che  number  of  AH-1  aircraft  hours  required  for  training, 

e  the  number  of  iterations  to  criteria  in  Che  AH-1  aircraft  (by 
task) I 

a  the  number  of  iterations  per  aircraft  hour  (collapsed  across 
tasks) . 

e  IP  proficiency  ratings  in  the  aircraft  (by  task),  and 

•  SIP  checkride  ratings  in  the  aircraft  (by  task) . 

Rusearch  products.  The  specific  products  expected  from  the 
refresher  training  research  include: 

•  the  data  with  which  to  assess  the  feasibility  and  benefits  of 
refresher  training  in  the  AHIFS,  afhd 

e  a  refresher  training  program  of  instruction. 

Resource  requirements.  Thirty-six  ARL3  AH-1  aviators  will  be 
required  to  conduct  this  research.  Additional  resource  requirements 
depend  on  the  site  at  which  the  research  is  conducted  and  the  ability  to 
incorporate  the  research  into  existing  training  programs. 


Basic  Enrichment  Training 

Research  requirement.  As  emphasized  earlier  in  this  report, 
Increased  operaticnal  effectiveness  is  the  ultimate  criterion  for 
evaluating  the  utility  of  the  AHIFS  for  unit  training.  The  assumption 
has  been  made  that  If  the  AHIFS  can  be  used  to  increase  Che  proficiency 
of  the  AH-1  aviators  assigned  to  the  unit,  the  AHIFS  will  have  made  a 
major  contribution  toward  Increasing  operational  effectiveness.  A 
second  assumption  made  here  is  that  the  training  requirements  for 
increasing  the  proficiency  of  low  time  aviators  are  markedly  different 
from  the  training  requirements  for  increasing  the  proficiency  of  medium- 
and  high-time  aviators.  Thus,  two  different  training  programs — basic 
enrichment  training  and  sustainment  and  advanced  enrichment  training — 
have  been  recommended  as  viable  training  programs  for  utilizing  the 
AHIFS  at  the  operational  units. 

Basic  enrichment  training  focuses  on  skill  enhancement  for  low- 
time  aviators  who  have  recently  completed  the  AH-I  AQC.  The  primary 
goal  of  basic  enrichment  training  Is  to  decrease  the  amount  of  time 
required  to  develop  the  level  of  skill  and  confidence  needed  to  assume 
the  responsibilities  of  PZC.  Unit  commanders  realize  that  the  opera¬ 
tional  effactlvenass  of  their  unit  depends,  to  some  extent,  on  how 
quickly  new  aviators  can  devalop  and  solidify  their  basic  skills  and 
assume  mission  reaponsibllitiss  once  held  by  vacating  aviators. 

Thus,  a  research  requiremant  exists  to  evaluate  the  extent  to 
which  basic  enrichment  training  in  the  AKIFS  increases  the  proficiency 
and  confidence  of  low-time  AH-1  aviators. 

Research  objective.  The  objective  of  this  resssrch  is  to  obtain 
data  with  which  to  asacss  tha  effectiveness  of  the  AHIFS  for  Incraasing 
the  levsl  of  flying  skills  and  confidence  of  low-time  aH-I  aviators. 

Research  approach.  Forty-eight  recant  AH-I  AQC  graduates  will 
receive  a  modified  commander 'e  checkride  upon  arrival  at  the  unit.  The 
modified  commander's  checkride  will  Include  mission  and  tactical  ATM 
tasks  that  the  aviator  will  be  required  to  perform  routinely.  Aviators 
will  be  assigned  to  one  of  four  groups  based  on  tho.  results  of  the 
checkride  by  the  unit  IP.  The  assignment  will  bo  made  tn  equate  initial 
proficiency  level  of  the  four  groups  of  aviators,  Based  on  a  coordi¬ 
nated  effort  with  the  unit  commander  and  unit  training  personnel,  each 
aviator  will  fly  approximately  2h  aircraft  hours  during  each  quarter  (3 
months)  for  a  period  of  one  year.  One  group  of  12  aviators  will  receive 
no  basic  enrichment  training  In  the  AHIFS  (control  group).  The  other 
three  groups  of  12  aviators  will  receive  6,  12,  and  IB  hours,  respec¬ 
tively,  of  basic  enrichment  training  in  the  AHIFS  each  quarter  for  a 
period  of  one  year.  The  simulator  training  is  in  addition  to  the  25 
hours  of  aircraft  training  that  aviators  in  all  four  groups  will  receive 
each  quarter. 
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At  the  end  of  each  quarter,  each  aviator  will  complete  a  modified 
commaader'a  evaluation  checkride.  These  data  will  be  used  to  assess  the 
relative  level  of  proficiency  of  aviators  as  a  function  of  amount  of 
simulator  training.  In  addition,  peer  evaluations  and  aviator's 
self-ratings  will  be  collected.  These  data  will  provide  additional 
insight  Into  Che  competence  and  confidence  of  the  aviators  and  will 
allow  for  meaningful  analysis  of  the  overall  affecClvaness  of  the  basic 
enrichment  training. 

Research  products.  The  specific  products  expected  from  the 
research  on  basic  enrichment  training  Include: 

e  data  with  which  to  plot  the  relationship  between  amount  of  basic 
enrichment  training  in  Che  simulator  and  proficiency  level, 

e  data  to  Mae  in  conjunction  with  cost  data  Co  define  the  most 
cost-effective  amount  of  basic  enrichment  training,  and 

e  a  basic  enrichment-training  program  of  instruction. 

Resource  requirements.  Forty-eight  low-time  AH-I  aviators  will  be 
requlrtd  to  conduct  this  resaarch.  Four  axptrlenced  AH-l  IPs  will  bs 
required  to  develop  data  collacClon  procaduras  and  to  conduct  the  AlllFS 
training.  About  2,000  AHIFS  hours  will  bs  required  to  conduct  the 
training  and  evaluations. 


Sustainment  and  Advanced  Enrichment  Training 

Raaaarch  raquiramenC.  Experienced  aviators  raqulra  training  to 
ensure  that  skills  to  perform  relavsnt  flight  Casks  ere  maintained  end 
that  Chase  ekllle  are  not  ae^ioualy  dagredad  by  environmental  or 
situational  constraints.  In  atteuipcing  to  delineate  the  types  of  AHiFS 
training  Chat  would  incrcaie  Che  operational  readlnaus  of  axparlanced 
aviators,  requirements  for  two  types  of  training  emerged. 

First,  great  benefits  would  be  realized  if  experienced  aviators 
could  use.  the  AHIFS  to  maintain  proficiency  on  tasks  for  which  skills 
are  not  maintained  during  routine  mission-support  flying.  Currently, 
AH-l  aviators  mtist  utilize  aircraft  time  to  practice  some  Casks.  Should 
it  be  demonstrated  that  the  AHiFS  can  be  used  for  skill  sustainment, 
valuable  aircraft  hours  could  be  devoted  to  training  casks  for  which 
skills  are  deficient  and  aircraft  training  is  tha  only  viable  option. 
It  should  be  noted  that  there  are  four  categories  of  tasks  for  which 
skills  are  not  maintained  during  routine  mission-support  flying: 

•  that  can  be  trained  in  the  aircraft  but  are  not  ordinarily 
penonned  during  routine  mission-support  flying, 

«  tasks  chat  cannot  be  trained  easily  in  the  aircraft  (e.g.,  IMC 
flight), 

•  tasks  that  are  not  currently  being  trained  in  tha  aircraft 
(e.g.,  touchdown  emergency  maneuvers),  and 


•  tasks  that  are  more  effectively  trained  In  the  AHIFS  (e.g,, 
gunnery  tasks). 

Taken  together,  these  represent  a  formidable  array  of  tasks  for  which 
skills  could  decay  without  sustainment  training  In  the  aircraft  or  the 
AHIFS. 

The  second  type  of  AHIFS  training  that  could  be  beneficial  for 
experienced  aviators  Is  skill  enrichment.  In  the  basic  enrichment 
training  program  discussed  earlier*  low-time  aviators  are  provided  with 
AHIFS  training  on  all  ATM  casks  under  daytime  and  nighttime  conditions; 
basic  enrichment  training  focuses  on  skill  solidification,  Increased 
competency,  and  increased  confidence  for  low-time  aviators.  For 
experienced  aviators.  It  Is  possible  to  concentrate  on  a  very  similar 
task  list,  but  increase  Che  complexity  of  the  tasks  by  requiring  the 
aviators  to  perform  the  tasks  under  adverse  conditions,  such  as  the 
following: 

e  wearing  night  vision  goggles, 

e  wearing  mission  oriented  protective  posture  (MOPF)  gaar, 

a  visual  obscurants  (rain,  snow,  fog,  smoke),  and 

e  wind  (gusts,  wind  sheer). 

Anecdotal  evidence  suggests  that  concern  for  safety  prevents  or 
severely  limits  the  extant  to  which  aviators  are  permitted  to  practice 
under  these  conditions.  And  yet,  military  doctrine  suggests  that, 
should  a  military  engagement  occur,  it  is  highly  probable  chat  there 
would  be  a  requirement  to  conduct  military  operations  uider  low 
Illumination  levels,  adverse  weather,  and/or  in  nuclear,  biological,  or 
chemical  (NBC)  conditions.  Therefore,  this  type  of  enrichment  training 
In  flight  slmurators  could  clearly  increase  the  operational  readiness  of 
the  units. 

For  the  most  part,  rotary  wing  training  programs  assume  that  by 
demonstrating  skill  proficiency  on  ATM  tasks,  the  svlator  will  be 
effective  when  required  to  perform  combinations  of  those  tasks  under 
wartime  conditions,  Although  ARTEP  training  provides  the  aviator  with 
valuable  insight  into  the  battlefield  experience,  ARTEP  training  focuses 
largely  on  coordination  and  cooperation  among  various  battle  elements. 
Because  of  safety  constraints,  it  Is  difficult,  if  not  impossible,  to 
"load  the  aviator  up"  with  mu]„tipla  teaks  requiring  rapid  decision 
making  and  effective  time-sharing  techniques.  However,  this  type  of 
training  Is  feasible  using  the  AHIFS.  For  this  reason,  it  appears 
highly  desirable  to  include  in  advanced  enrichment  training  a  set  of 
mission  scenarios  that  are  designed  to  Increase  aviators'  ability  to 
perform  effectively  during  periods  of  heavy  cognitive  and  perceptual- 
motor  workload. 

In  addition  to  the  above,  advanced  enrichment  training  should 
include  training  in  nlr-to-alr  combat  and  training  in  evasive  actions 
for  other  throat  weapons,  including  air  defense  weapons  and  small  arms 
fire. 


Taken  togecher,  chese  types  of  training  for  experienced  avlatorst 
subsumed  under  sustainment  and  advanced  enrichment  training,  represent 
an  attempt  to  formulate  an  effective  training  strategy  for  not  only 
sustaining  but  also  Increasing  proficiency,  thereby  Improving  the 
operational  effectiveness  of  the  units. 

Research  objectives.  The  specific  objectives  of  the  research  on 
sustainment  and  advanced  enrichment  training  are  to  obtain  data  with 
which  to  assess  the  effectiveness  of  the  AHIFS  for  each  of  the 
following! 

e  facilitating  skill  sustainment  on  those  tasks  not  performed 
during  routine  mission  flying, 

a  facilitating  skill  acquisition  and  sustainment  for  a  variety  of 
ATM  tasks  under  a  variety  of  adverse  conditions  (NVG,  MOPP  gear, 
visual  obscurants,  wind), 

■  increasing  proficiency  under  high  workload  conditions, 

a  Increasing  air-to-air  combat  proficiency, 

s  increasing  proficiency  In  performing  the  full  range  of  evasive 
actions,  and 

e  increasing  aviator  Judgment  ability  under  a  wide  range  of 
conditions . 

Research  approach.  Forty-eight  experienced  AH-1  aviators  will  be 
divided  into  four  groups.  Assignment  procedures  will  be  developed  to 
ensure  that  the  four  groups  are  matched  in  terms  of  initial  proficiency 
level  and  flying  experience.  Scores  on  a  commander's  checkrlde,  flight 
hours  logged  In  the  AH-1  aircraft,  hours  logged  in  other  aircraft,  types, 
and  perhaps  other  demographic  variables  will  be  used  In  assigning 
aviators  to  the  four  groups.  One  group  of  12  aviators  will  perform 
their  normal  flight  routine  within  the  unit  (control  group).  Each  of 
the  three  other  groups  of  12  aviators  will  receive  6,  12,  or  18  hours, 
respectively,  of  AHlFS  training  per  quarter  for  a  period  of  one  year. 
The  AHIFS  training  will  include  both  sustainment  training  and  advanced 
enrichment  training.  Rased  on  a  cooperative  effort  with  unit  commanders 
and  unit  training  personnel,  each  aviator  will  fly  approximately  25 
hours  per  quarter  and  will  be  limited  to  the  types  of  tasks  they  can 
perform. 

At  the  end  of  each  quarter,  each  aviator  will  receive  a  profi¬ 
ciency  checkrlde  (in  an  aircraft).  Although  this  checkride  will  Include 
as  many  tasks  as  possible,  a  checkride  on  some  of  the  tasks/conditions 
trained  In  the  AHIFS  will  probably  not  be  possible  without  Incurring  an 
unacceptable  level  of  risk.  In  addition  to  IP  ratings,  each  aviator  In 
the  experimental  groups  will  be  asked  to  provide  assessments  of  the 
effectiveness  of  the  training  programs.  These  types  of  data  will  be 
collected  each  quarter  for  a  period  of  one  year.  At  the  end  of  one 
year,  the  data  will  be  analyzed  to  determine  (a)  the  effectiveness  of 
the  AHIFS  for  each  type  of  training,  nnd  (b)  the  optimal  number  of  hours 


In  Che  AHIFS  to  facilitate  skill  proficiency.  Together,  these  data  will 
provide  the  basis  for  an  overall  evaluation  of  Che  effectiveness  of  the 
AHIFS  for  training  experienced  aviators.  . 

Research  products.  The  research  products  expected  from  the 
sustainment  and  advanced  enrichment  training  research  Include; 

e  data  with  which  to  plot  the  relationship  between  proficiency 
level  and  amount  of  sustainment  and  advanced  enrichment 
training, 

e  data  to  use  In  conjunction  with  cost  data  to  specify  the  most 
cost-effective  amount  of  sustainment  and  advanced  enrichment 
training,  and 

•  a  sustainment  and  advanced  enrichment  training  program  of 
instruction. 

Resource  requirements.  Forty-eight  experienced  AH-1  aviators  will 
be  required  to  conduct  this  research.  Four  experienced  AH-1  IPs  will  be 
required  to  conduct  the  AHIFS  training.  About  2,000  AHIFS  hours  will  be 
required  to  develop  data  collection  procedures  and  to  conduct  the 
training  and  evaluations. 


Safety  Enhancement  Training 

This  subsection  describes  research  to  evaluate  the  effectiveness 
of  the  AHIFS  in  conducting  four  different  types  of  safety  enhancement 
training. 


Accident  Scenario  Training 

Research  requirement.  Although  some  aircraft  training  Is  aimed 
specifically  at  countering  accidents,  aircraft  training  in  potential 
accident-producing  situations  necessarily  Involves  some  risk  of  causing 
the  very  type  of  accident  the  training  is  designed  to  counter.  This 
risk  would  be  eliminated  if  Army  aviators  could  acquire  the  necessary 
accident  avoidance  skills  in  a  flight  simulator  rather  than  in  an 
aircraft.  In  addition  to  risk  reduction  during  training,  It  Is 
altogether  possible  chat  aviators  could  acquire  a  higher  level  of 
accident  avoidance  skills  In  the  flight  simulator  than  in  an  aircraft. 
In  a  flight  simulator.  It  Is  possible  to  expose  Che  trainee  to  all 
events  up  to  and  including  the  crash  itself.  Such  exposure,  of  course, 
Is  not  possible  in  Che  aircraft. 

Accident  scenario  training  is  one  type  of  training  that  promises 
to  reduce  the  incidence  of  frequently  occurring  accident  types.  As  was 
stated  earlier,  accident  scenario  training  Involves  the  use  of  a  flight 
simulator  to  re-enact,  as  faithfully  as  possible,  all  the  conditions  and 
actions  that  have  been  shown  to  contribute  (directly  or  indirectly)  to  a 
frequently  occurring  type  of  accident. 


The  accident:  types  to  be  Investigated  during  this  research  will  be 
selected  with  the  assistance  of  personnel  from  the  U.  S.  Army  Safety 
Center.  However,  based  upon  the  Information  presently  available,  it 
appears  likely  chat  the  following  accident  types  will  be  among  the  ones 
selected  for  study: 

e  brown-out  by  blowing  dust, 
e  dynamic  roll-over, 
s  loss  of  tall  rotor  effectiveness,  and 
e  settling  with  power. 

Descriptions  of  the  above  accident  types  can  be  found  In  TM  55-1520- 
210-10  and  FM  1-51. 

Research  objective.  The  objective  of  this  research  is  to  assess 
the  effectiveness  of  the  AH-1  flight  simulator  for  training  aviators  to 
avoid  and/or  recover  from  known  accident-producing  situations. 

Research  approach.  The  most  valid  data  on  Che  effectiveness  of 
accident  scenario  training  would  come  from  a  longitudinal  study  In  which 
accident  Involvement  of  avlatore  who  received  the  accident  scenario 
training  is  compared  with  accident  involvement  of  aviators  who  did  not 
receive  the  training.  However,  boceuee  of  the  low  Incldsnca  of 
accidents,  a  longitudinal  study  would  require  the  training  of  large 
numbers  of  evtatora  and  the  monitoring  '  of  accident  records  for  an 
extended  period  of  time.  For  this  reason,  a  longitudinal  study  is 
considered  unfesaible  at  chie  time. 

The  research  approach  that  appears  most  feaslbla  is  an  in-  ■ 

simulator  study  in  which  the  measure  of  training  ef fectlveneas  is  the 

dagfee  to  which  simulator  training  under  one  set  of  conditions  transfers 
to  ln-aimulst:or  performance  under  a  different  set  of  conditions.  Two 
groups  of  15  AH-1  aviators  will  be  matched  on  selected  demographic 
variables.  One  group  of  IS  AH-I  aviators,  the  experimental  group,  will 
first  be  tested  and  then  trained  on  each  accident  type  under  one  set  of 
conditions.  Following  the  training,  the  conditions  for  each  accident 
type  will  be  changed  and  the  experimental  group  aviators  will  be 
retested  on  the  same  accident  types  but  under  different  conditions.  A 
second  group  of  15  of  AH-1  aviators,  the  control  group,  will  be 
pretested  and  ponttested  in  the  same  manner  as  the  experimental  group 
aviators.  The  dif£er,pnce  between  the  two  groups  is  that,  rather  than 
simulator  training,  the  control  group  will  receive  only  academic 

instruction  on  the  nature  of  the  accident  types  and  the  techniques  for 
avoiding  them. 

Two  types  of  performance  maasuras  will  be  used;  in-simulator 

recovery  rates,  and  In-simulator  proficiency  ratings  by  experienced  IP. 

Research  products.  The  research  products  expected  from  the 
accident  scenario  training  include: 


•  data  with  which  to  assess  the  feasibility  of  accident  scenario 
training!  and 

t  an  accident  sconario  training  program  of  Instruction. 

It  should  be  noted  that  the  research  proposed  above  will  not 
provide  the  data  needed  to  define  the  most  cost-effective  amount  of 
simulator  training.  If  the  concept  proves  feasible  (a  substantial 
amount  of  In-slmulator  transfer  Is  found) »  additional  research  will  be 
required  to  obtain  Che  data  needed  to  define  the  most  cost-effective 
amount  of  accident  scenario  training  in  Che  AHIFS. 

Resource  requirements.  Thirty  AH-1  aviators  who  are  current  in 
Che  AH-1  aircraft  will  be  required  to  accomplish  this  research.  It  is 
estimated  that  a  total  of  200  simulator  hours  will  be  required  Co  (a) 
develop  the  testing  and  training  procedures,  and  (b)  conduct  Che 
training  and  the  evaluations.  In  addlcloni  two  exparlsnced  AH-1  IPs 
will  be  required  to  operate  the  flight  simulator  and  to  evaluate  the 
performance  of  the  experimental-group  and  control-group  aviators. 


Extrsma  Condltlona  Training 

Research  requirement.  Because  of  a  unit  commander's  concarn  for 
safety,  most  aircraft  training  is  conducted  whan  environmental  condl¬ 
tlona  are  optimal  or  near-optimal.  Although  aircraft  training  during 
adverse  environmental  conditions  would  Increase  aviators'  combat  capa¬ 
bilities,  such  training  is  certain  to  Increase  Che  incidence  of  training 
accidents.  It  seems  reasonable  to  hypothesise  that  flight  simulator 
training  under  adverse  conditions  would  decrease  accident  likelihood, 
especially  under  combat  conditions  where  frequent  exposure  to  adverse 
conditions  is  to  be  expected. 

Research  objective.  The  objective  of  this  research  la  Co  assess 
the  effectiveness  of  the  AH-1  flight  simulator  for  training  aviators  to 
operate  the  aircraft  in  extreme  environmental  conditions. 

Research  approach.  A  conventional  transf er-of-Cralning  paradigm 
would  yield  Che  most  valid  assessment  of  the  effectiveness  of  the  flight 
simulator  for  training  aviators  Co  operate  effectively  under  extreme 
conditions.  However,  measuring  performance  in  Che  aircraft  unde,;: 
extreme  conditions  almost  certainly  will  involve  an  unacceptably  high 
accident  risk.  The  next  best  option  is  an  In-aimulator  transfer 
paradigm  of  the  type  described  above  in  connection  with  accident 
scenario  training. 

Further  analytic  study  is  required  to  make  final  decisions  about 
the  type  and  range  of  extreme  conditions  that  should  be  investigated  and 
to  define  the  taskCs)  to  be  trained  under  each  set  of  extreme  condi¬ 
tions.  The  development  of  a  detailed  rese.nrch  approach  is  not  possible 
until  this  analytic  study  has  been  completed. 
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Research  products.  The  ruaearch  products  expected  from  the 
research  on  extreme  conditions  training  Include: 

■  data  with  which  to  assess  the  feasibility  of  extreme  conditions 
training,  and 

a  an  extreme  conditions  training  program  of  instruction. 

It  should  be  noted  that  the  research  proposed  above  will  not 
provide  the  data  needed  to  define  the  most  cost-effective  amount  of 
simulator  training.  If  the  concept  proves  feasible  (a  substantial 
amount  of  In-slmulator  transfer  is  found),  additional  research  will  be 
required  to  obtain  the  data  needed  to  define  the  most  cost-effective 
amount  of  extreme  conditions  training  In  the  AHlFS. 


Resource  requirements.  A  reasonably  precise  estimate  of  the 
resource  requirements  Is  not  possible  until  the  extreme  conditions  to  be 
investigated  have  been  determined.  For  present  purposes,  it  is  esti¬ 
mated  that  the  resource  requirements  for  this  study  will  be  the  same  as 
those  for  the  accident  scenario  training  research  $  30  AH-1  aviators, 
about  200  hours  of  AH-1  flight  simulator  time,  and  two  experienced  AH-l 
IPs  for  the  duration  of  data  collection. 


Flight  Envelope  Training 

Research  requlranent.  Safety  considerations  prevent  IPs  from 
exposing  trainees  to  the  handling  qualities  of  the  helicopter  when 
flying  near,  the  extremes  of  the  flight  envelope.  Consequently,  aviators 
may  be  unprepared  to  control  the  aircraft  when  the  situation  requires 
them  to  fly  st  or  near  the  extremes  of  the  helicopter's  flight  envelope, 
If  true,  accident  likelihood  could  be  reduced  by  using  the  AHlFS  to 
train  aviators  to  operate  at  or  near  the  limits  of  the  AH-1  aircraft. 
The  reduction  in  accident  likelihood  could  be  of  critical  importance  in 
combat,  where  extreme  maneuvers  may  be  essential  for  survival.  The 
Intent  is  to  search  the  accident  files  of  the  U.S.  Army  Safety  Center 
for  accidents  that  have  resulted  from  aviator  Inability  to  control  the 
aircraft  at  the  extremes  of  the  flight  envelope.  This  type  of  accident 
prevention  training  would  focus  on  these  uccidents. 

Research  objective.  The  objective  of  this  research  la  to  obtain 
data  with  which  to  evaluate  the  effectiveness  of  the  AHLFS  for  training 
aviators  to  fly  at  or  near  the  extremes  of  the  AH-1  flight  envelope. 


Measuring  performance  in  the  aircraft  while  flying  at  the  extremes 
of  the  aircraft's  performance  envelope  almost  certainly  would  Involve  an 
excessive  degree  of  risk.  Hence,  It  Is  unlikely  that  a  conventional 
transfer-of-tralning  paradigm  could  be  used  to  maaeure  the  effectiveness 
of  the  simulator  training.  As  was  true  for  both  flight  scenario 
training  and  extreme  conditions  training,  an  in-slmulator  transfer 
paradigm  probably  represonte  the  only  feasible  approach  to  assess  the 
effectiveness  of  flight  envelope  training  in  the  flight  simulator. 


Further  analytic  study  is  required  to  identify  Che  specific 
objectives  of  the  flight  envelope  training.  The  development  of  a 
detailed  research  approach  is  not  possible  until  this  analytic  study  has 
been  completed. 

Research  products.  The  research  products  expected  from  the 
research  on  flight  envelope  training  include: 

e  data  with  which  to  assess  the  feasibility  of  flight  envelope 
training,  and 

•  a  flight  envelope  training  program  of  instruction. 

It  should  be  noted  that  Che  research  proposed  above  will  not 
provide  Che  data  needed  to  define  the  most  cost-effective  amount  of 
simulator  training.  If  the  conespt  proves  fsasible  (a  substantial 
amount  of  In-simulator  transfer  is  found),  additional  research  will  be 
required  to  obtain  the  data  needed  to  define  the  most  cost-affactivs 
^  I  amount  of  flight  envelope  training  in  the  AIUFS. 

Reaource  requirements.  A  reasonably  precise  estimate  of  Che 
resource  requiremenCe  in  not  poselble  until  the  flight  envelope  training 
!  requirements  have  been  defined  end  a  detailed  reaearch  design  hoe  been 

I  developed,  For  present  purposes,  it  la  estimated  that  Che  resource 

requirements  for  this  study  will  be  the  same  as  those  for  Chs  accident 
Bccnario  training  research:  30  AH-1  aviators,  about  200  houra  of  AH-1 
flight  elmulator  time,  end  two  experienced  AH-1  IPs  for  the  duration  of 
the  data  collection. 

.  \ 

I 

Judgment  Training 

Research  requirement.  There  is  clear  evidence  that  poor  Judgment 
is  a  frequent  contributor  to  botn  civil  and  military  aircraft  accidents 
I  (Lindsey,  Ricketsen,  Reeder,  &  Smith,  1983;  Jensen  &  Benel,  1977),  and 

there  is  growing  evidence  that  judgment  training  has  the  potential  for 
reducing  the  Incidence  of  such  accidents  (Berlin,  Gruber,  Holmes, 

'  Jensen,  Lau,  Mills,  fi  O'Knne,  1982;  Brecke,  1982;  Jensen  i  Benel,  1977). 

Preliminary  study  indicates  that  judgment  training  on  some  judgment- 
related  accidents  could  best  be  conducted  in  a  flight  simulator. 

Re'Search  objective.  The  objective  of  this  research  is  to  obtain 
data  with  which  to  evaluate  the  effectiveness  of  the  AHIFS  for  providing 
training  that  reduces  potentially  accident-producing  judgment  errors. 

Research  approach.  The  judgment  training  discussed  here  differs 
from  the  Judgment  training  discussed  in  connection  with  advanced 
enrichment  training  in  that  the  present  training  will  focus  only  on 
judgment  errors  that  have  been  shown  to  to  accident  producing.  Once 
such  judgment  errors  have  been  identified  by  the  U.S.  Army  Safety 
Center,  simulator  training  to  curtail  the  key  Judgment  errors  will  be 
developed  and  administered  to  a  group  of  IS  qualified  AH-I  aviators 
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(experimental  group).  An  equivalent  amount  of  academic  instruction  on 
the  key  decision  errors  will  be  administered  to  a  demographlcally 
matched  group  of  15  AH-1  aviators  (control  group).  Both  the  experl- 
mental  group  aviators  and  the  control  group  aviators  will  be  pretested 
and  posttested  in  the  simulator  on  flight  scenarios  that  require  Judg¬ 
ments  of  the  type  under  Investigation.  The  two  groups  will  be  compared 
In  terms  of  the  frequency  with  which  the  correct  Judgments  are  made  and. 
if  appropriate.,  the  time  required  to  make  the  Judgment. 

Research  products.  The  research  products  expected  from  the 
research  on  Judgment  training  Include: 

e  data  with  which  to  assess  the  feasibility  of  Judgment  training, 
and 

e  a  Judgment  training  program  of  Instruction. 

It  should  be  noted  that  the  research  proposed  above  will  not 
provide  the  data  needed  to  define  the  moat  cost-effective  amount  of 
simulator  training.  If  the  concept  proves  feasible  (a  substantial 
amount  of  In-slmulatov  transfer  Is  found),  additional  research  will  be 
required  to  obtain  the  data  needed  to  define  the  moat  cost-effective 
amount  of  Judgment  training  in  the  AHIFS. 

Resource  requirements.  The  resource  requirements  are  the  same  as 
those  estimated  for  the  extreme  conditions  training  study. 


Maintenance  Test  Pilot  Training 

Research  requirement.  Maintenance  Test  Pilots  (MTPs)  ordinarily 
become  qualified  by  completing  a  course  of  instruction  at  the  United 
States  Army  Aviation  Logistics  School  (USAALS).  Aviators  may  also 
receive  MTF  qualification  by  successfully  completing  an  KTP  equivalency 
examination  administered  by  a  USAALS  Maintenance  Test  Plight  Evaluator 
(MTFE) .  In  either  case,  MTPs  must  learn  to  perform  a  variety  of 
inflight  maneuvers  to  assess  the  functioning  of  the  aircraft  and  to 
correctly  diagnose  malfunctions  when  they  are  present.  Like  other  unit 
aviators,  MTPs  have  continuation  training  requirements  they  must  fulfill 
(see  FM  55-44).  Many  of  the  maneuvers  that  MTPs  must  perform  during 
training  and  during  maintenance  check  flights  are  violent  and 
potentially  hazardous.  " 

Initial  training  and  continuation  training  of  MTPs  is  a  poten¬ 
tially  beneficial  application  of  the  AHIFS.  However-  the  benefit  of 
such  training  will  depend  upon  the  extent  to  which  aircraft  malfunctions 
can  be  programmed  and  the  fidelity  of  the  simulator's  response  to  the 
programmed  malfunctions.  Research  to  assess  the  benefits  of  KTP 
training  in  the  AHIFS  will  be  conducted  if  the  preliminary  research 
shows  that  a  sufficient  number  of  malfunctions  can  be  programmed  and  the 
simulator's  response  to  the  malfunctions  Is  acceptable. 
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Reaaarch  objactiva.  The  objective  of  this  research  is  to  assess 
the  effectiveness  of  the  AHIFS  for  training  MTPa. 

ReseaT'^ih  approach.  k  traditional  transfer-of-tralnlng  paradigm 
will  be  employed  to  assess  the  training  effectiveness  of  the  AHLFS  for 
MTP  training.  One  group  of  ten  medium-time  AH-1  aviators— the 
experimental  group— will  receive  training  In  the  AHIFS  and  then  will  be 
trained  to  criterion  In  the  aircraft.  A  matched  group  of  ten  AH-1 
;  Mvlators— the  control  group— will  receive  no  training  before  being 
trained  to  criterion  in  the  aircraft.  The  effectiveness  of  the 
simulator  training  will  be  assessed  by  comparing  the  two  groups  In  terms 
of  (a)  the  flight  hours  required  to  reach  criterion  In  the  alrcraft»  and 
(b)  the  proficiency  ratings  received  on  the  final  checkride. 

Research  products.  The  research  products  expected  from  the 
1 1  research  on  MTP  training  Include: 

//  e  data  with  which  to  assess  the  feasibility  of  MTP  training,  and 

e  an  MTP  training  program  of  Instruction. 

It  should  be  noted  that  the  research  proposed  above  will  not 
provide  the  data  needed  to  define  the  most  cost-effective  amount  of 
simulator  training.  If  the  concept  proves  feasible  (a  substantial 
amount  of  In-simulatot  transfer  Is  found),  additional  research  will  be 
required  to  obtain  the  data  needed  to  define  the  most  cost-effective 
amount  of  MTP  training  In  the  AHIFS. 

Resource  requirements.  Twenty  qualified,  medium-time  aviators 
will  be  required  to  serve  as  subjects  In  this  research.  Two  qualified 
MTFEs  will  be  required  to  conduct  the  training  In  the  AHIFS.  The 
aircraft  training  and  In-alrcraft  checkrldes  will  be  conducted  In  the 
same  manner  and  by  the  same  personnel  as  are  used  to  train  other  MTPs. 


AN  ASSESSMENT  OF  THE  EFFECTIVENESS  OF  TRAINING  HELICOPTER 
INITIAL  ENTRY  STUDENTS  IN  SIMULATORS 

INTRODUCTION 

The  research  described  In  this  subsection — Training  Helicopter 
Initial  Entry  Students  in  Simulators  (THIESIS)— Is  the  only  research 
discussed  In  Section  III  that  la  specifically  aimed  at  the  use  and 
benefits  of  flight  simulators  for  Institutional  training. 

Background 

Students  entering  the  Army's  lERW  course  learn  their  basic  contact 
flying  skills  in  the  TH-55  aircraft— a  small  two-place  helicopter  the 
Army  uses  exclusively  for  training.  After  50  hours  of  in-flight 
training  in  the  TH-55,  lERW  students  receive  125  hours  of  training  in 
the  UH-lH  aircraft.  To  achieve  Instrument  qualification,  students  must 
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complete  40  hours  of  instruction  In  the  UH-l  flight  simulator.  After 
becoming  qualified  in  the  UH-l  aircraft,  students  nay  Join  an  opera¬ 
tional  unit  as  a  UH-l  aviator  or  enter  qualification  training  in  another 
aircraft  type. 

There  is  a  clear  and  pressing  need  to  consider  alternatives  to 
training  basic  flight  skills  In  the  TH-5S  helicopter.  The  reasons  for 
this  need  are  explained  below. 

Cost/availablllcy  of  training  aircraft.  The  TH-55  is  ths  only 
helicopter  in  the  Army's  Inventory  Chat  requires  high  octane  aviation 
fuel.  In  the  event  of  a  major  fu^l  shortage,  high  octane  fuel  could 
become  costly  enough  or  scarce  enough  to  disrupt  the  Army's  lERW 
training  program.  Furthermore,  maintaining  a  separate  fleet  of  aviation 
fuel  trucks  and  an  aviation  fuel  contract  is  buthereome  and  expansive. 

A  more  important  concern  is  the  impending  end  of  the  useful  life 
of  the  TH-SS.  At  present,  no  new  TH-55  aircraft  arc  being  acquired  to 
replace  chose  in  the  aging  fleet.  A  phase-out  of  the  TH-S5  would 
require  Che  Army  to  select  from  among  three  training  options!  the 
acquisition  of  a  new  training  aircraft  to  replace  the  TH>55,  the  conduct 
of  primary  flight  training  in  an  aircraft  that  is  now  in  the  Army 
Inventory,  or  training  helicopter  initial  entry  students  in  simulators 
(THIESIS) . 

It  seems  unlikely  that  a  decision  will  b«.  luade  to  purchase  a  new 
training  helicopter,  The  Department  of  Defense  has  resisted  proposals 
to  develop  and  produce  aircraft  that  are  to  be  used  solely  for  training. 
Furthermore,  the  Army  has  a  strong  desire  to  channel  all  available 
resources  into  operational  equipment  (Roscoe,  1980). 

The  replacement  of  training  In  the  TH-5S  with  training  in  an 
operational  helicopter  is  not  a  promising  option  because  most  opera¬ 
tional  Army  helicopters  are  far  more  costly  and  consume  considerably 
more  fuel  than  the  TH-55  (Grice  &  Morresette,  1982).  iSased  upon  initial 
cost  and  fuel  consumption  alone,  it  appears  that  the  OH-58  is  the  only 
helicopter  in  the  Army  inventory  that  is  even  marginally  suitable  for 
use  in  conducting  primary  training. 

Availability  of  other  training  resources.  Because  of  limited 
training  resources  at  Fort  Rucker,  the  Army  is  unable  to  accoiu.modate  a 
large  and  sudden  surge  in  the  training  load.  During  the  mobilization  of 
Army  aviation  for  the  Vietnam  War,  lERW  graduates  exceeded  5,000  par 
year.  During  this  period,  primary  training  in  the  TH-55  was  conducted 
at  Fort  Welters,  Texas;  only  the  advanced  phases  of  lERW  were  conducted 
at  Fort  Rucker.  When  the  Army  phased  down  pilot  fainlng,  all  lERW 
training  was  consolidated  at  Fort  Rucker,  and  the  number  of  lERW 
graduates  was  reduced  to  fewer  than  1,000  per  year.  The  current  lERW 
'rainlnc  load — about  2,000  students  per  year — severely  taxes  the  usable 
airspace  and  physical  facilities  at  the  USAAVNC.  In  the  event  of 
another  major  mobilization,  USAAVNC  would  be  hard  pressed  to  increase 


the  number  of  graduates  to  that  of  the  Vietnam  era  without  exceeding  the 
capacity  of  existing  airspace,  stageflalds,  and  other  physical 
facilities  at  Fort  Rucker.  The  reactivation  of  Fort  Wolters  is  a 
feasible  option,  but  a  very  costly  one.  It  Is  possible  that  a  more 
cost-effective  option  is  to  Increase  the  training  capability  of  Fort 
Rucker  by  increasing  the  amount  of  training  that  is  conducted  In  flight 
simulators. 

THIESIS  feasibility  study.  The  accomplishment  of  THIESIS  research 
is  complicated  by  the  lack  of  a  UHIFS  equipped  with  a  visual  system. 
Before  racommendlng  the  development  of  such  a  device  for  use  in 
conducting  comprehensive  THIESIS  research,  it  was  deemed  essential  to 
conduct  a  preliminary  study  to  evaluate  the  feasibility  of  the  THIESIS 
concept.  Such  a  study  was  recently  completed  at  the  Aviation  Center. 
The  THIESIS  training  was  conducted  in  an  AHlFS:  a  highly  complex  flight 
simulator  that  Is  equipped  with  a  motion  platform  and  a  camera- 
modelboard  visual  system.  The  loading  and  balance  of  the  AHlFS  were 
adjusted  such  that  the  handling  qualities  of  the  AHlFS  were  as  similar 
as  possible  to  those  of  the  UH-1  aircraft. 

A  group  of  tan  student  aviators  were  trained  on  basic  flight  tasks 
in  the  AH-1  simulator  (exparlmantal  group).  A  matched  group  of  tsn 
student  aviators  received  conventional  training  in  tha  TH-55  aircraft 
(control  group).  Once  the  Primary  Phase  of  lERW  training  had  been 

completed,  members  of  both  the  experimental  group  and  the  control  group 
progressed  through  the  same  training  sequence  throughout  the  remainder 

of  lERW  training,  which  is  conducted  in  the  UH-1  aircraft.  Data  on 

academic  grades,  flight  grades,  flight  hours,  and  satbacka  vara  recorded 
for  both  groups  throughout  training.  In  addition,  questionnaire  data 
were  collected  from  both  students  and  IPs  at  critical  points  throughout 
training. 

Only  two  students  failed  to  complete  the  lERW  training  program 
satisfactorily.  One  member  of  the  experimental  group  voluntarily 
withdrew  from  the  program,  and  one  member  of  the  control  group  was 

involuntarily  removed  from  the  program  due  to  lack  of  satisfactory 
progress.  Although  data  analyses  are  still  underway,  It  is  clear  that 
receiving  primary  training  in  the  AHlFS  did  not  significantly  handicap 
members  of  the  experimental  group  during  the  stages  of  lERW  training 
that  follow  the  Primary  Phase.  The  few  problemo  that  the  experimental 
group  subjects  encountered  In  transitioning'  from  the  simulator  to  the 
aircraft  appear  to  be  due  to  (a)  differences  In  the  handling  qualities 
of  the  AHlFS  and  the  UH-1  aircraft,  and  (b)  shortcomings  in  the  vlsvial 
system.  Both  problems  manifest  themselves  in  poor  initial  performance 
on  hovering  tasks.  These  problems  should  not  be  encountered  if  a  UHIFS 
equipped  with  a  suitable  visual  system  was  used  for  THIESIS  training. 

Although  detailed  conclusions  cannot  be  drawn  until  the  data 
analyses  have  been  completed.  It  Is  clear  that  the  outcome  of  the 
feasibility  study  is  sufficiently  promising  to  justify  further  research 
in  this  Important  area. 


Development  of  UH-1  trelnlng-rcseerch  simulator.  In  order  to 
proceed  further  with  the  THIESIS  researchi  it  is  necessary  to  develop  a 
(JH-1  training  research  slmuletor.  A  research  simulator  suitable  for 
this  research  must  be  equipped  with  a  visual  system  and  must  have 
reasonably  high  fidelity  handling  qualities  throughout  Che  range  of  the 
flight  envelope  (UH-1  aircraft)  typically  encountered  In  performing  the 
casks  Caught  during  Che  Primary  Phase  of  lERW  training.  The  Army  has 
recently  contracted  with  personnel  from  the  University  of  Alabama  to 
design  and  develop  a  UH-1  training-research  simulator  that  will  be  uead 
to  conduct  further  THIESIS  research  and  perhaps  other  research  as  well. 
An  existing  Slngar-Llnk  2B-24  IffilFS  is  being  equipped  with  a  Digital 
Image  Generator  (DIG)  visual  system  (front  and  side  window)  and  improved 
equations  of  motion. 


Research  Objectives 

|t  A  three-phase  line  of  research  Is  envisioned.  The  objectives  of 

each  of  Che  three  phases  are  listed  below: 

^  e  Phase  I  objectives  (Transfer  Study) 

—Evaluate  cost  effectiveness  of  using  a  UHIFS  equipped  with  a 
visual  display  for  Primary  Phase  training 
—Determine  training  transfer  functions  to  UH-I  aircraft 
—Develop  optimal  THIESIS  prograiu  of  instruction  from  transfer 
data 

—Determine  Che  contribution  of  platform  motion  to  training 
effectiveness 
g- 

e  Phase  II  objectives  (Integration  Study) 

—Determine  the  optimum  Integration  of  simulator  and  helicopter 
''  training  to  complete  the  Primary  Phase  training  objectives 

—Evaluate  the  TH-55  and  UH-1  helicopters  for  integration  with  a 
'  visual  simulator  for  Primary  Phase  training 

— Evaluate  visual  display  technologies  for  cost  and  training 
effectiveness 

•  Phase  III  objectives  (Complexity  Study) 

--Determine  the  relationship  between  simulator  complexity 
(visual  system,  motion  system,  cockpit  diaplays/controls,  and 
handling  qualities)  and  Primary  Phase  training  effectiveness 
— Determine  the  most  cost-effective  level  of  complexity  for  each 
simulator  design  parameter 


RESEARCH  APPROACH 

Detailed  plans  for  the  THIESIS  research  cannot  be  formulated  until 
the  UH-1  training-research  simulator  has  been  designed,  delivered,  and 
evaluated  and  preliminary  research  has  bean  completed.  Consequently,  it 
is  possible  to  describe  only  the  general  research  approaches  to  be 
employed  during  each  phase  of  the  research  at  this  time. 
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Phase  I;  Transfer  Study 

A  series  of  conventional  tranefar-of-t raining;  experiments  will  be 
conducted  using  Primary  Phase  students  as  subjects.  Independent 
variables  to  be  Investigated  Include  at  least  the  following: 

e  tasks  trained  In  the  slinulator» 

e  amount  of  simulator  training  received  (training  time  and  number 
of  practice  Iterations) > 

e  scene  content  of  visual  display  system,  and 

e  simulator  Instructional  method/procedures. 

All  experiments  will  employ  one  or  more  control  groups  that 
receive  training  different  from  the  simulator-trained  experimental 
group(a).  At  least  one  control  group  will  receive  no  simulator  training 
whatsoever.  Following  the  completion  of  Primary  Phase  training, 
subjects  in  all  groups  will  be  trained  to  criterion  In  the  UH-lH 
aircraft.  The  same  training  methods  and  procedures  will  be  used  to 
train  all  subjects  in  the  UH-1  aircraft. 

The  dependent  variables  will  include  performance  measures  and 
ratings  In  both  the  simulator  (experimental  groups)  and  the  aircraft 
(experimental  and  control  groups).  Although  a  complete  listing  of 
dependent  variables  cannot  be  formulated  at  this  time,  it  seems  certain 
that  the  final  list  will  include  at  least  the  following: 

e  practice  time  and  iterations  to  criterion  (by  task), 

•  cask  ratings  by  IPs, 

•  daily  grades  by  IPs. 

e  checkrlde  scores,  and 

e  measures  of  selected  flight  parameters  (simulator  only). 


Phase  II:  Integration  Study 

The  fundamental  premise  underlying  the  Phase  II  research  is  that 
interspersing  simulator  training  and  aircraft  training  will  result  In 
greater  training  effectiveness  than  completing  all  simulator  training 
prior  to  cxposl:ig  students  to  Che  aircraft  for  the  first  time.  To  fully 
assess  the  merits  of  this  concept,  it  Is  necessary  Co  determine  the 
relationship  between  training  cost  (total  cost  of  training  to  a 
prescribed  level  of  proficiency  in  the  UH-1  aircraft)  and  four 
Independent  variables:  training  mode  (TH-55  aircraft,  ITHIFS,  and  UH-1 
aircraft),  amount  of  training  for  each  mode,  tasks  trained  with  each 
mode,  and  the  sequence  of  training  by  mode  (the  manner  in  which  the 
modes  are  Interspersed) .  It  is  clear  that  Is  would  be  excessively 
costly  to  employ  a  complete  factorial  design  with  four  variables  and 
several  levels  of  each  variable.  However,  a  suitable  alternative  design 
has  not  yet  been  formulated.  It  is  possible  that  a  design  based  on 
response-surface  methodology  will  prove  feasible.  Otherwise,  It  will  be 


necaaaary  to  addrssa  this  isEue  through  a  sarlaa  of  analytical  and 
amplrlcal  studies  that  may  not  provide  the  date  needed  to  define  the 
single,  most  cost-effective  mix  of  training  modes. 


Phase  III:  Complexity  Study 

The  Phase  III  research  assumes  the  development  of  the  capability 
to  vary  the  complexity  (or  fidelity)  of  selected  simulator  design 
parametera.  It  Is  not  possible  to  formulate  a  meaningful  approach  for 
Phase  III  research  until  detailed  Infomation  Is  available  on  the 
capability  to  vary  complexity,  specifically,  the  parameters  whose 
complexity  can  be  varied  and  the  extent  to  which  the  complexity  of  each 
parameter  can  be  varied. 


RESEARCH  PRODUCTS 

The  products  expected  from  the  THIESIS  research  are  listed  below 
by  research  phase: 

e  Phase  I: 

— data  describing  transfer  of  training  functions  for  transfer 
from  the  UHIFS  to  UH-1  aircraft, 

—conclusions  about  the  training  effectiveness  of  motion,  and 
—conclusions  about  the  training  effectiveness  of  computer 
graphics  visual  system. 

e  Phase  II: 

—data  with  which  to  define  optimal  Integration  of  simulator  and 
aircraft  training  for  Primary  Phase  training, 

— recommendation  of  most  tralnlng/cost-ef fectlve  visual  display 
technology,  and 

— recommendation  of  most  tralning/cost-ef fectlve  computer 
technolcgy. 

e  Phase  III: 

— data  with  which  to  define  the  most  cost/ training-ef fectlve 
level  of  complexity  for  simulator  design  parametera 
Investigated, 

— recommendation  of  optimal  hardware  configuration  for  low-cost, 
hlgh-rellabllity  THIESIS  training,  and 
— a  program  of  instruction  for  Primary  Phase  training. 


RESOURCE  REQUIREMENTS 

As  was  stated  earlier,  further  progress  on  the  THIESIS  research  Is 
not  possible  until  a  UH-I  training  research  simulator  is  available.  Any 
attempt  to  specify  other  resource  requirements  would  be  premature  until 
the  precise  capabilities  of  the  training  research  simulator  are  known 
and  preliminary  research  has  been  completed.  Only  Chen  will  it  be 
possible  to  develop  detailed  research  designs,  which,  in  turn,  dictate 
the  resources  required  to  accomplish  the  THIESIS  research. 
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INVESTIGATING  THE  FEASIBILITY  OF  USING  VISUAL  FLIGHT  SIMUUTORS 
FOR  NIGHT  VISION  GOGGLE  TRAINING 


INTRODUCTION 

Th«  purpose  of  the  reeeerch  dlicuesed  in  this  eubsectlon  is  to 
assess  the  fesslbillty  of  using  e  UH60FS  for  night  vision  goggle  (NVG) 
training.  Although  NVG  training  in  simulators  is  an  important  topic  for 
the  AHIFS  research  discussed  in  the  previous  subsection •  the  Army's  nead 
for  data  with  which  to  assess  the  UH60FS's  utility  for  NVG  training  is 
so  pressing  that  it  cannot  await  the  completion  of  the  AHIFS  research • 
as  outlined  in  the  previous  subsection.  Hence »  it  la  recommended  that 
the  following  research  be  Initiated  as  soon  as  possible  even  though  some 
duplication  of  effort  may  result  from  this  strategy. 


Background 

During  the  past  two  decadest  there  has  been  a  major  re-evaluation 
of  traditional  military  strategies  Involving  Army  aviation.  Specifi- 
callyi  recent  military  experience  indicates  that  technological  advances 
in  aircraft  datactlon  and  ground-to-air  weaponry  requires  Army  aviators 
to  (a)  employ  low-sltltude  tacticsi  including  NOE  flighty  as  an  integral 
part  of  their  offensive  and  defensive  strategies,  and  (b)  expand  their 
operational  capabilities  to  Include  nighttime  and  adverse  weather 
conditions.  The  combination  of  these  two  requirements— the  performance 
of  low-altitude  tactics  under  low  levels  of  illumination— may  represent 
the  greatest  challenge  to  face  Army  aviation  in  its  history. 

The  ability  of  Army  aviators  to  perform  terrain  flight  maneuvers 
and  to  navigate  in  unfamiliar  environments  at  night  using  unaided 
scotopic  vision  is  limited  by  the  availability  of  ambient  light. 
Without  sufficient  ambient  light,  the  aviator  simply  cannot  see  the 
terrain  clearly  enough  to  fly  safely  or  to  navigate  effectively.  For 
more  than  a  decade,  the  Department  of  the  Army  has  sponsored  research 
and  development  (RSD)  aimed  at  producing  a  night  vision  device  that 
facilitates  the  performance  of  terrain  flight  tactics  under  low  levels 
of  illumination. 

The  R&D  effort  began  during  the  latter  part  of  the  Vietnam  war 
when  it  became  obvious  that  Army  aviators  must  be  capable  of  performing 
terrain-flight  tactics  during  the  day  and  at  night  in  order  to  survive 
mid-intensity  warfare.  Based  on  a  recommendation  from  a  Modern  Army 
Selected  System  Test,  Evaluation,  and  Review  (KASSTER) ,  an  IPR  committee 
directed  that  a  low-cost  night  vision  goggle  (NVG)  device,  originally 
developed  for  use  by  ground  personnel  (Johnson,  Tipton,  Newman,  Wood,  A 
Intano,  1972),  be  adopted  as  an  interim  solution  to  terrain  flight  under 
low  levels  of  Illumination.  Thus,  the  Army  Navy/Pilot  Visual  System 
(AN/PVS-5)  NVG  was  procured  and  a  Required  Operational  Capability  (ROC) 
was  Issued  without  formal  developmental  testing  or  operational  testing. 


The  standard  AN/PVS-S  KVG  la  a  binocular  device  with  unity 
magnification.  It  Is  approximately  6^  inches  square,  weighs  28  ounces, 
and  provides  a  40*  fleld-of-vieu  with  a  visual  acuity  of  approximately 
20/50.  The  device  contains  two  electro-optical  systems  designed  to 
perform  optimally  under  low  levels  of  Illumination.  Each  electro- 
optical  system  contains  an  Image  Intenslfler  tube  that  Increases  the 
number  of  ambient  light  particles  and  utilizes  fiber  optics  to  project  a 
visual  image  onto  a  green  phosphorous  plate. 

The  IPR  committee  accepted,  the  AM/PVS-S  NVG  as  an  "Interim 
solution"  to  the  requirement  for  a  night  vision  device  to  facilitate 
performance  of  Array  aviators.  The  committee  members  knew  from  the 
outset  that  the  AN/PVS-5  NVG  was  not  ideally  designed  for  use  In  an 
aircraft  cockpit.  Therefore,  it  was  not  surprising  that  subsequent 
research  and  experience  demonstrated  that  the  standard  AN/FVS-5  NVG  la 
only  a  narglnally  acceptable  night  vision  device  (see  Cunning.  1983). 
However,  the  problems  revealed  by  the  research  and  experience  have 
guided  the  modifications  of  the  standard  AN/PVS-5  (McLean.  1982)  as  well 
as  Che  design  of  Che  newest  night  vision  device.  Che  Aviator  Night 
Vision  Image  System  (ANVIS)  (Richardson  &  Crew,  1981). 


Need/Problem 

Pursuant  to  the  instructions  of  the  IPR  Conunlttee  ROC,  NVG 
training  requirements  were  established  and  detailed  In  the  ATM  for  each 
Amy  aircraft.  Each  ATM  specifies  the  prerequisites  for  NVG  training, 
as  well  as  the  academic  and  flight  training  requirements  for  NVG  quali¬ 
fication  training,  NVG  continuation  training,  and  NVG  refresher 
training.  For  example,  to  become  NVG  qualified,  an  aviator  must: 

e  receive  10.5  hours  of  academic  instruction  in  night  (unaided) 
flight  and  NVG  flight  procedures, 

e  demonstrate  proficiency  in  the  perfomance  of  all  ATM  tasks 
(except  for  the  5,000  series  tasks)  during  night  (unaided) 
flight, 

•  receive  1.5  hours  of  cockpit  blackout  training  prior  to 
beginning  NVG  flight  training,  and 

•  receive  between  8.5  and  13.5  hours  of  NVG  flight  training  prior 
to  demonstrating  proficiency  to  an  NVG  qualified  IP. 

The  ATM  requirements  for  NVG  qualification  training  are  represen¬ 
tative  of  the  training  requirements  for  NVG  continuation  training  and 
NVG  refresher  training.  That  is,  except  for  1,5  hours  of  cockpit 
blackout  training,  all  flight  training  is  conducted  In  the  sircraft. 

Given  the  safety  problems  associated  with  using  night  vision 
devices  during  rotary-wing  flight,  it  is  probable  that  accident  risks 
can  be  reduced  by  accomplishing  soma  portion  of  NVG  training  In  visual 
flight  simulators,  prior  to  NVG  training  In  the  aircraft.  Furthermore, 


if  the  NVG  flight  training  currently  being  conducted  In  the  aircraft  can 
be  augmented  by  training  In  vlaual  flight  simulators)  there  Is  a 
potential  for  enormous  savings  In  manpower,  aircraft  time,  and  other 
resource  requirements. 


Research  Objectives 

The  specific  objectives  of  this  research  are  as  follows: 

e  to  Identify  the  NVG  tasks  that  can  be  trained  in  a  visual  flight 
simulator, 

e  to  develop  a  POI  to  be  used  in  training  KVG  tasks  In  a  visual 
flight  simulator,  and 

e  to  determine  the  feasibility  of  NVG  training  In  visual  flight 
simulators . 


Research  Approach 

A  two-phase  research  approach  is  recommended.  The  first  phase  is 
an  In-ilmulator  skill  acquisition  study  that  addrassea  the  fsaslblllty 
question  in  a  short  period  of  time  and  with  a  relatively  small  amount  of 
resources.  This  research  design  provides  Information  about  the  NVG 
skill  acquisition  of  10  UH-60  Aviation  Qualification  Course  (AQC) 
graduates  undergoing  NVG  training  In  the  UH60FS.  Each  subject  will  bo 
trained  on  relevant  NVG  tasks  during  five  three-hour  simulator  sessions. 
By  comparing  each  subject's  performance  on  each  ATM  task  during  the 
fifth  simulator  session  with  his/her  performance  on  the  same  ATM  task 
during  Che  first  simulator  session.  It  la  possible  to  ausess  Che  extent 
to  which  performance  of  NVG  tasks  In  the  simulator  improves  with 
simulator  training.  Tasks  for  which  In-slmulator  skill  acquisition  Is 
exhibited  will  be  retained  for  further  study  during  Che  second  phase. 

The  second  phase  is  a  traditional  transfer-of-tralnlng  study  that 
addresses  the  most  Important  questions  associated  with  NVG  training  In 
visual  flight  simulators.  This  study  Is  designed  to  allow  detailed 
comparisons  of  performance  and  skill  acquisition  of  (a)  a  group  of 
subjects  trslned  to  NVG  qualification  In  the  UH-60  aircraft  (control 
group),,,  and  (b)  a  group  of  subjects  who  receive  NVG  training  in  the 
UH60FS  prior  to  NVG  qualification  training  in  Che  UH-60  aircraft 
(experimental  group) .  The  results  of  this  research  design  can  be  usad 
to  (a)  assess  Che  rate  of  skill  acquisition  during  training  In  a  visual 
flight  simulator,  (b)  Identify  the  transfer-of-tralnlng  from  Che 
simulator  to  tha  aircraft  by  task,  and  (c)  estimate  the  total  savings  In 
aircraft  time,  IP  time,  and  other  resources  Chat  can  be  realized  from 
training  In  visual  flight  simulators.  This  design  Is  resource  Intensive 
and  requires  extensive  support  by  various  Fort  Rucker  agencies. 


Raaaarch  Product! 


Tha  products  that  can  be  expected  from  this  research  include:  (a) 
a  listing  of  tha  tasks  for  which  NV6  training  is  faaslbla  and 
banoflclal,  (b)  data  with  which  to  assess  tha  cost-effectlvanesa  of  NVG 
training  in  a  flight  alniulator^  (c)  a  program  of  Instruction  that  can  bo 
used  in  either  an  Institutional  or  unit-training  sattlngi  and  (d)  36 
aviators  that  era  partially  trained  (16)  or  fully  trained  (20)  on  NVG 
flight  in  the  UH-60  aircraft • 


Raaourca  Raqulraments 

The  development  of  a  program  of  instruction  to  use  in  conducting 
the  research  will  require  six  UH-60  AQC  graduates  to  serve  aa  subjects, 
one  IP,  sbout  50  UH-60  aircraft  hours,  and  about  50  UH60FS  hours. 

The  first  phase  of  tha  UH60FS  NVG  rasaarch  will  require  10  UH-60 
AQC  graduates  to  serve  as  subjects,  five  UH-60  IPs,  and  about  220  hours 
of  UH60FS  time,  Each  subject  will  be  required  to  davote  about  40  hours 
to  orientation)  academic  training,  and  flight  simulator  training  over  a 
tan- day  period. 

The  second  phase  of  the  research  will  require  20  UH-60  AQC 
graduates  to  serve  as  subjects,  six  IPs,  about  360  UH-60  aircraft  hours, 
and  about  160  UH60FS  hours.  Each  subject  will  be  required  to  devote 
about  60  hours  to  orientation,  academic  training,  aircraft  training,  and 
flight  simulator  training  over  a  15-day  period. 

It  should  be  noted  that  about  one-third  of  tha  academic  instruc¬ 
tion  and  flight  hours  required  to  conduct  this  research  is  davotad  to 
training  on  unaided  night  flight.  Tha  requirement  for  this  time  would 
be  eliminated  if  the  research  could  be  conducted  at  a  field  unit  using 
pilots  who  are  already  qualified  on  unaided  night  flight. 
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autorotation 


Perform  simulated  hydraulic 
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governor 
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**Slmulator  requirements  not  yet  finalized. 
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for  flight  control  system 
malfunction 
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for  electrical  system 
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drive  train  malfunctions 


Perform  antitorque  failure 
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cockpit  displays  and  controls.  The  purposs  of  the  second  Lins  ^  rasssrch 
Is  to  datanilns  how  best  to  use  production  simulators— slwula'^asr  that  have 
bean  or  are  soon  to  be.  acquired  by  the  Amy.  This  11ns  of  research  focuses 
primarily  on  the  use  of  production  simulators  for  flsld  unit  aviators* 
aviators  vho  have  completed  Institutional  training  and  have  bean  assigned 
to  an  operational  field  unit.  However,  the  second  line  of  research 
addresses  some  issues  sssoclatqd  with  the  use  of  flight  simulators  for 
Institutional  tralnlng-‘*tralning^t  the  U.  8.  Army  Aviation  Center  received 
prlor~eo  the  aviator's  first  assignment  to  an  operational  unit. 

This  document  was  prepared  to  serve  as  a  vehicle  for  initiating  meaningful 
dialogue  among  the  agencies  and  personnel  who  share  responsibility  for 
optlmlalng  the  benefits  of  the  Army's  Synthetic  Flight  Training  System 
(SFTS)  program;  it  has  not  bean  officially  endorsed  by  any  Army  agency. 
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•  FOREWORD 


Th«  Amy  is  committed  to  the  use  of  flight  simulators  to  augment 
the  training  that  Army  helicopter  pilots  receive  In  the  helicopter 
Itself.  The  most  important  reasons  for  this  commitment  are  discussed  in 
the  main  body  of  the  report.  For  now.  It  Is  sufficient  to  say  thst  the 
use  of  flight  simulators  to  augment  aircraft  training  Is  the  only  means, 
during  peacetime,  of  achieving  the  level  of  operational  readiness  that 

Is  desired  at  anlfiOAt . Chmt-:-tr*^accepCablif.  Until  now.  nearly  all  the 

resources  expended  by  the  Army  on  its  Synthetic  Flight  Training  System 
(SFTS)  program  have  been  aimed  at  hardware  development  and  acquisition. 
The  resources  devoted  to  research  on  how  best  to  use  flight  simulators 
is  miniscule  by  comparison.  Hence.  It  Is  not  surprising  that  there  are 
a  large  number  of  uncertainties  about  the  specific  role  of  flight 
simulators  In  the  Army's  aviator  training  program.  It  Is  worth  noting 
that  these  uncertainties  are  not  unique  to  the  Army;  both  the  Air  Force 
and  Navy  ara  faced  with  much  the  same  problems. 

In  preparing  this  document,  the  authors  and  contributors  attempted 
to  be  thorough  in  Identifying  critical  research  iesuea.  Also,  to  the 
extent  possible  with  the  time  and  resources  available,  an  attempt  was 
made  to  develop  research  plans  that  address  the  Issues  In  a  meaningful 
and  practical  vay,  \la  feel  confident  that  the  research  Issues  identi¬ 
fied  are'"^ frlleVant^  and~-wea-t rivlafi  However,  ve  do  not  consider  the 
reaeerch  plans  presented  In  this  document  to  be  the  only  way  or  r''1^roceB- 
sarlly/"the  bast  way  to  deal  with  tha^ ^issues  Identified.  When 
developing  long-term  research  on  a  topic*' 1^  which  so  little  la  known, 

It  must  be  expected  that  the  results  of  earlier  research  may  drastically 
change  one's  early  views  about  the  best  way  to  proceed.  In  short,  the 
plans  for  later  stages  of  the  research  must  be  considered  tentative  and 
subject  to  change,  baaed  upon  the  findings  of  earlier  research. 

It  can  be  argued  that  plans  for  research  on  such  a  difficult  topic 
should  proceed  In  a  step-by-step  fashion.  Indeed,  the--»te;>“by-se«p  / 
approach  is  much  less  tht;eatenlng  to  the  ^research  planner  who  must 
formulate*  rewoaa^eh^  pl^'ank  ’  tlmb  are'  basutl  up'on  premises  several  levels 
removed  from  any  empirical  data.  Also,  this  approach  Is  less  likely  to 
portray  to  decision  makers  a  research  requirement  that  Initially  appears 
overwhel|pingly  complicated  and  costly.  The  disadvantages  of  the  step- 
by-step  approach,  which  we  feel  far  offset  the  advantages,  are  twofold. 
First,  a  great  deal  of  time  and  research  continuity  would  be  lost  If 
efforts  to  obtain ,  funding  and  administrative  support  for  the  next 

research  stage  Are  not  commenced  until  the  results  of  the  preceding 

stage  have  been  fully  enslysed  end  documented.  A  hiatus  between  each 
stage  of  research  would  probably  serve  to  make  a  difficult  job 

Impossible.  Second,  a  general  notion  of  the  scope  of  the  research  la 
needed  to  make  sensible  decisions  abjut  whether  or  not  to  embark  on  the 
research  and,  if  an  affirmative  decision  Is  made,  to  make  sensible 

decisions  about  how  beat  to  marshal  the  resources  needed  to  continue  the 
research  until  truly  useful  results  ere  in  hand.  For  these  reasons,  we 
have  decided  that  relatively  detailed  long-term  plans — even  Imperfect 
ones— serve  an  Important  purpose. 


The  Incent  le  that  thla  document  eerve  as  a  beginning  of  dialogue 
among  the  agencies  and  personnel  who  share  responsibility  for  optimizing 
the  benefits  of  the  Army's  SETS  program.  It  Is  hoped  that  this 
dialogue,  in  turn^  will  lead  to  the  refinement  of  ideas,  to  the 
establishment  of  Research  priorities,  and  to  joint  planning  by  all 
Involved  agencies.  It  la  Important  that  the  reader  keep  In  mind  that 
this  Is  not  a  document  that — l-i’~  being  submitted  for  approval  or 
disapproval,  In  total  or  In  part.  For  this  reason,  feedback  from 
readers  about  flaws  In  the  premises  and/or  reasoning  are  welcomed. 
Comments  should  be  sent  to  Mr.  Charles  A.  Gainer  at  the  following 
address: 

Chief 

ART  Field  Unit 

Attn:  PERI-IR  (Mr.  Charles  A.  Gainer) 

Fort  Rucker,  AL  36362-5354 


EDGAR  M.  JOHNSON 
Technical  Director 
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AN  ENUMERATION  OF  RESEARCH  TO  DETERMINE  THE  OPTIMAL  DESIGN  AND  USE 
OF  ARMY  FLIGHT  TRAINING  SIMUUTORS 


EXECUTIVE  SUMMARY 

The  purpose  of  this  document  Is  to  Identify  the  types  of  reaearch  thet-^ — 
APe'^heeded  to  determine  the  optimal  design  and  use  of  Arny  flight 
simulators.  Two  complementary  lines  of  reaearch  are  described  and 
discussed.  One  line  of  research — referred  to  as  the  "Long-Term  Path"-- 
focuses  primarily  on  simulator  design  issues.  The  primary  focus  of  the 
second  line  of  research— the  "Short-Term  Path" — is  the  determination  of 
the  best  way  to  use  the  flight  simulators  Chat  have  been  or  are  soon  to 
be  acquired  by  the  Army. 


LONG-TERM  PATH 

The  general  obJectl‘’e8  of  the  Long-Term  Path— formulated  by  the 
Assistant  Secretary  of  the  Amy  for  Research,  Development,  and 
Acquisition— are  as  listed  below: 

e  design  research  chat  will  yield  the  data  needed  to  quantify  the 
relationship  between  fidelity  (in  selected  flight  simulator 
design  parameters)  and  training  transfer  (for  selected  flying 
tasks) , 

e  design  research  that  will  yield  the  data  needed  to  define  the 
relationship  between  flight  simulator  production  coats  and 
required  fidelity  in  the  selected  flight  simulator  design 
parameters,  and 

e  design  research  to  define  the  type,  cost,  and  effectiveness  of 
alternate  training  methods  and  media  that  could  be  used  in  lieu 
of  flight  simulators  tn  train  one  or  more  of  the  selected  flying 
Casks . 

In  response  to  the  general  research  objectives,  requirements  for 
research  were  defined  for  five  "primary"  research  areas  and  nine 
"supportive"  research  areas.  The  primary  research  areas  araff  ((  '  '' 

tl  ^ 

t  fidelity  requirements  for  visual  system, 

e  fidelity  requirements  for  motion  system, 

•  fidelity  requirements  for  simulator  handling  qualities, 

•  fidelity  requirements  for  cockpit  displays  and  controls,  and 

e  requirements  for  simulator  Instructional  Support  Features. 

The  supportive  research  areas  are  topical  areas  f'or  which  there  are 
problems  or  uncertainties  that  must  be  resolved  in  order  to  conduct 
effective  research  in  the  primary  research  areas.  Supportive  research 

areas  Identified  and  discussed  Include:  '  '  -  f 

/  J 


•  flying  task  data  bass, 

•  team/comb Ined-anas  training  mathods, 
a  perfornanca  avaluatlon. 

a  alternative  training  medlat 
a  aubsystem  standardizatlon/tnodularlaatlont 
a  research  methodology, 
a  akin  decay/malneananca. 

a  Implemsntation/monltorlng  of  almulator  training,  and 
a  cost-affectlvenesa  analyala  modela. 

The  dlscuaalon  of  each  of  the  above  reaearch  areaa  Includaa  a 
description  of  the  reaearch  Issues  and  objectives,  comments  about 
relevant  research  thit  has  been  reported  In  the  literature,  and  a 
description  of  the  research  considered  necessary  to  resolve  the  Issues. 
The  research  plana  vary  widely  in  detail  and  complexity. 


SHORT-TERM  PATH 

The  Short-Term  Path  la  a  program  of  research  that  la  aimed  at  evaluating 
and  optimising  the  usa  of  the  family  of  flight  simulators  that  the  Army 
already  has  acquired  or  haa  contracted  to  purchase.  Since  the  design  of 
this  family  of  simulators  la  fixed,  the  reaearch  Is  focused 
mainly  on  determining  how  best  to  uss  the  devices:  yho  should  be 
trained,''  yhet  tasks  should  be  tralnad^  how  much  training  should  be 
administered^^  and  what  training  methods  should  be  employed  for  each 
training  application.^  A  secondary  objective  of  the  Short-Term  Path  is 
to  Identify  design  modifications  (hardware  snd/or  software)  that  will 
Improve  the  training  effectiveness  of  production  simulators  without 
Incurring  excessive  product  Improvement  costs. 

Three  major  research  efforts  are  described.  The  objective  of  the  first 
rebesrch  effort  la  to  determine  the  optimal  use  of  flight  simulators  In 
a  unit-training  context.  (Unit  training  refers  to  the  training  received 
by  Amy  aviators  after  they  have  completed  Institutional  training  and 
have  been  assigned  to  an  operational  unit.)  The  research  is  designed  to 
assoRR  the  simulator's  utility  for  five  different  training  applications: 
refresher  tr.iinlng,  skill  sustainment  training,  skill  enrichment 
training,  accident  prevention  training,  and  maintenance  teat-pilot 
training. 

O 

The  objective  of  the  second  research  effort  is  to  evaluate  the  simu¬ 
lator's  utility  for  training  beginning  students  In  the  fundamentals  of 
helicopter  operation.  A  three-phase  study  ^is  describee!  that  addresses 
both  simulator  design  Issues  and  training  methodology  IssueeV  If  the 
early  work  supports  the  fsaalhlllty  of  the  concept,  tranafer-of-training 
studies  will  be  conducted  to  determine  the  optimal  mix  of  simulator 
training  and  aircraft  training. 


The  objective  of  the  third  research  effort  is  to  determine  the  extent  to 
which  Night  Vision  Coggle  training  can  be  accomplished  in  a  flight 
simulator  equipped  with  a  visual  system. 
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AAA  -  Army  Audit  Agency 

AFHRL  -  Air  Force  Hunan  Reaources  Laboratory 

AGARD  -  Advisory  Group  for  Aerospace  Research  and  Development 

AGL  -  Above  Ground  Level 

AH  -  Attack  Helicopter 

AHIP  -  Army  Helicopter  Improvement  Program 
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ATM  -  Aircrew  Training  Manual 

BOIP  -  Basis  of  Issue  Plan 
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IFR  -  Instrument  Flight  Rules 

ICE  -  In-Ground  Effect 

ILS  -  Instrument  Landing  System 

TMC  -  Instrument  Meteoi  .  logical  Conditions 

IP  -  Instructor  Pilot 

IPR  -  In-Process  Review 

IR  -  Infrared 


ISP  -  Instructional  Support  Features 

LOD  -  Level  of  Detail 

MASSTER  -  Modern  Army  Selected  System  Test,  Evaluation,  and  Review 

MOPP  -  Mission  Oriented  Protective  Posture 

MTPE  -  Maintenance  Teat  Flight  Evaluator 

MTP  >  Maintenance  Test  Pilot 
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